-- Logs begin at Mon 2022-08-22 16:08:45 UTC, end at Mon 2022-08-22 17:56:18 UTC. -- Aug 22 17:16:41.936866 dv-cinder-853941-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 22 17:16:41.951707 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 22 17:16:41.953779 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 17:16:41 2022] *** Aug 22 17:16:41.953779 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 17:16:41.953779 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 17:16:41.953779 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: nodename: dv-cinder-853941-2-iscsi Aug 22 17:16:41.953779 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: machine: x86_64 Aug 22 17:16:41.953779 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: clock source: unix Aug 22 17:16:41.953779 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: pcre jit disabled Aug 22 17:16:41.953779 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: detected number of CPU cores: 4 Aug 22 17:16:41.953779 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: current working directory: / Aug 22 17:16:41.953779 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: detected binary path: /usr/bin/uwsgi-core Aug 22 17:16:41.953779 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: your processes number limit is 47680 Aug 22 17:16:41.956341 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: your memory page size is 4096 bytes Aug 22 17:16:41.956341 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: detected max file descriptor number: 2048 Aug 22 17:16:41.956341 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: lock engine: pthread robust mutexes Aug 22 17:16:41.956341 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: thunder lock: enabled Aug 22 17:16:41.956341 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 22 17:16:41.956341 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 17:16:41.996187 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: Python main interpreter initialized at 0x55e308d479c0 Aug 22 17:16:41.996187 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: python threads support enabled Aug 22 17:16:41.996187 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: your server socket listen backlog is limited to 100 connections Aug 22 17:16:41.996187 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: your mercy for graceful operations on workers is 90 seconds Aug 22 17:16:41.996726 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 17:16:41.996726 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: *** Operational MODE: preforking *** Aug 22 17:16:41.996925 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: *** uWSGI is running in multiple interpreter mode *** Aug 22 17:16:41.996925 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: spawned uWSGI master process (pid: 106456) Aug 22 17:16:41.997200 dv-cinder-853941-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 22 17:16:41.999632 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: spawned uWSGI worker 1 (pid: 106477, cores: 1) Aug 22 17:16:41.999632 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: spawned uWSGI worker 2 (pid: 106478, cores: 1) Aug 22 17:16:41.999632 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 17:16:42.712406 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 17:16:42.788207 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 17:16:43.857646 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:16:43.857646 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: from cryptography.utils import int_from_bytes Aug 22 17:16:43.858585 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:16:43.858585 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: from cryptography.utils import int_from_bytes Aug 22 17:16:43.918819 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:16:43.918819 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: from cryptography.utils import int_from_bytes Aug 22 17:16:43.919755 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:16:43.919755 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: from cryptography.utils import int_from_bytes Aug 22 17:16:46.570838 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 17:16:46.571437 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 17:16:46.571677 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 17:16:46.572049 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 17:16:46.572305 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 17:16:46.572697 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.573021 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.573355 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.573668 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.574001 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.574315 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.574675 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.574997 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.575328 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.575590 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.575918 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.576245 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853941-2-iscsi {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.576569 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.576879 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.577195 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.577516 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.577666 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 17:16:46.578356 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.578519 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 17:16:46.578681 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.578681 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.578953 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 17:16:46.580935 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.581196 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 17:16:46.581385 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.581385 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.581682 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 17:16:46.581832 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.581998 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.582164 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.582164 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.582460 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.582645 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.582807 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.582954 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.582954 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.583304 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.583460 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.583460 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.583749 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.583906 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853941-2-iscsi {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.583906 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.584183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.584340 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.584483 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.584639 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.584639 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.584906 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.585047 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.585047 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.585322 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.585476 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.585622 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.585765 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.585945 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.586120 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.586258 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.586609 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853941-2-iscsi {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.586768 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.586912 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.587153 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.587323 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.587534 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.587699 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.587843 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.588151 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.588301 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.588458 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.588697 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.588850 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.589063 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.589209 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.589351 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.589615 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.589804 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.589946 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.590223 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.590390 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.590598 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.590823 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.591079 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.591230 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.591516 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.591671 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.591826 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.592007 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.592153 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.592297 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.592619 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.592769 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.593022 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.593224 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.593373 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.593529 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.593770 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.593929 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.594128 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.594316 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.594534 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.594787 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.594949 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.595269 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.595421 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.595756 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.595909 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.596116 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.596363 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.596513 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.596765 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.596998 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853941-2-iscsi {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.597166 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.597419 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.597579 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.597723 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.598017 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.598183 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.598357 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.598600 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.598753 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.599017 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.599288 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.599456 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.599629 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.599835 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.599983 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.600307 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.600514 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.600709 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.600882 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.601096 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.601255 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.601458 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.601631 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.601868 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.602030 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.602186 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.602588 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.602762 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.602922 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.603065 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.603209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.603399 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.603603 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.603755 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.604007 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.604167 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.604374 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.604638 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.604802 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.604946 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.605184 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.605338 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.605557 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.605715 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.605859 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.606183 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.606334 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.606514 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.606773 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.606937 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.607120 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.607324 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.607473 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.607738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.607922 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.608068 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.608283 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.608448 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.608674 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.608844 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.608993 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.609306 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.609456 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.609626 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.609870 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.610035 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.610218 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.610363 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.610570 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.611304 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.611453 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.611745 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.611880 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.612109 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.612306 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.612457 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.612778 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.612942 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.613086 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.613317 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.613484 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.613676 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.613864 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.614028 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.614281 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.614429 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.614650 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.614913 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.615066 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.615255 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.615462 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.615627 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.615900 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.616049 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.616192 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.616454 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.616607 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.616802 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.617008 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.617170 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.617454 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.617643 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.617835 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.618110 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.618315 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.618624 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.618824 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.619010 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.619213 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.619394 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.619574 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.619768 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.619949 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.620140 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.620344 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.620523 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.620716 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.620946 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.621142 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.621321 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.621560 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.621749 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.621943 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.622132 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.622313 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.622583 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.622792 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.622999 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.623220 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.623402 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.623583 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.623835 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.624026 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.624211 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.624388 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.624567 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.624789 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.624987 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.625172 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.626251 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.626435 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.627108 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.627328 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.627514 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.627514 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.627933 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.628132 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.628132 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.628612 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.628762 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.628908 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.629052 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.629052 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.629316 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.629472 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.629618 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.629760 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.629760 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.630090 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.630303 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.630303 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.630682 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.630840 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.630987 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.631141 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.631300 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.631445 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.631589 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.631836 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.631982 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.632136 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.632449 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.632605 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.632750 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.632982 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.633134 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.633406 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.633578 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.633723 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.633985 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.634148 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.634295 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.634616 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.634770 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.634915 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.635105 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.635272 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.635569 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.635733 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.635941 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.636124 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.636336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.636540 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.636711 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.636885 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.637180 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.637361 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.637509 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.637694 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.637850 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.638033 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.638174 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.638370 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.638617 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.638765 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.639027 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.639208 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.639355 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.639564 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.639717 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.639943 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.640106 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.640258 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.640545 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.640766 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.640914 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.641121 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.641285 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.641445 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.641685 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.641838 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.642243 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.642395 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.642608 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.642868 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.643009 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.643263 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.643396 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.643636 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.643895 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.644073 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.644274 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.644420 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.644605 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.644919 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.645098 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.645252 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.645454 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.645622 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.645844 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.645991 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.646204 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.646445 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.646665 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.646811 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.647068 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.647243 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.647407 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.647618 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.647770 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.647967 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.648161 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.648395 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.648569 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.648705 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.648889 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.649198 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.649357 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.649517 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.649739 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.649891 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.650093 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.650252 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.650446 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.650783 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.650949 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.651133 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.651339 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.651491 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.651790 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.651953 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.652114 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.652371 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.652525 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.652738 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.652909 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.653073 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.653387 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.653541 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.653779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.653965 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.654137 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.654456 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.654654 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:16:46.654783 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.654964 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.655108 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.655417 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.655565 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.655749 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.656311 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.656519 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.656724 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.656880 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.657025 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.657274 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.657420 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.658159 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.658426 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.658770 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.658922 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.659163 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.659459 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.659459 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.659758 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.659927 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.660071 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.660211 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.660357 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.660654 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.660875 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.661027 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.661210 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.661374 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.661574 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.661767 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.661935 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.662196 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.662359 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.662550 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.662823 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.662981 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.663148 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.663416 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.663568 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.663803 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.663972 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.664130 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.664444 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.664615 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.664763 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.664996 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.665151 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.665366 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.665558 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.665723 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.665984 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.666153 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.666300 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.666616 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.666753 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.666926 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.667178 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.667330 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.667546 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.667715 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.667858 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.668161 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.668333 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.668479 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.668757 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.668922 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.669077 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.669329 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.669482 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.669627 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.669870 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.670021 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.670265 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.670427 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.670591 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.670918 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.671187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.671398 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.671547 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.671756 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.671904 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.672062 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.672212 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.672430 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.672577 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.672722 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.673027 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.673905 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.674184 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.674407 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.675023 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.675023 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.675421 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.675590 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.675590 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.675859 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.676004 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.676004 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.676285 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.676451 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.676451 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.676732 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.676872 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.677030 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.677162 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.677360 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.677567 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.677721 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.677974 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.678122 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.678266 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.678616 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.678787 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.679078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.679225 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.679371 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.679528 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.679766 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.679919 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.680128 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.680310 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.680461 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.680731 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.680893 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.681039 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.681327 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.681659 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.681810 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.681975 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.682269 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.682426 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.682659 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.682829 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.682980 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.683250 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.683454 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.683650 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.683869 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.684024 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.684223 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.684431 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.684602 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.684835 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.684999 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.685144 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.685443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.685605 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.685760 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.686013 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.686166 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.686338 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.686583 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.686764 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.686978 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.687169 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.687374 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.687574 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.687721 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.687878 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.688173 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.688323 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.688487 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.688730 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.688939 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.689158 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.689469 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.689695 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.689861 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.690100 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.690372 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.690585 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.690731 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.690885 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.691029 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.691312 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.691483 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.691631 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.691851 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.692002 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.692297 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.692446 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.692639 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.692880 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.693035 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.693242 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.693416 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.693606 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.693940 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.694092 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.694238 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.694541 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.694699 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.694864 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.695071 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.695222 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.695433 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.695639 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.695790 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.696045 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.696193 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.696342 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.696645 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.696801 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.696945 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.697186 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.697339 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.697532 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.697727 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.697890 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.698145 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.698307 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.698454 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.698772 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.698922 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.699068 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.699377 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.699593 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.699740 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.699959 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.700111 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.700256 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.700526 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.700776 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.700923 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.701063 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.701191 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.701440 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.701673 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.701832 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.702047 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.702207 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.702352 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.702709 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.702945 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.703095 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.703238 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.703381 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.703585 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.703778 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.703983 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.704187 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.704335 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.704668 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.704819 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.704962 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.705272 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.705413 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.705610 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.705808 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.706015 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.706215 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.706360 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.706624 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.706831 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.706979 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.707146 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.707404 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.707558 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.707722 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.707953 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.708120 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.708313 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.708496 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.708649 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.708910 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.709060 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.709238 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.709539 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.709694 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.709840 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.710068 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.710233 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.710424 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.710668 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.710819 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.711101 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.711280 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.711458 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.711730 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.711891 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.712065 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.712272 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.712424 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.712685 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.712847 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.712992 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.713298 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.713448 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.713592 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.713865 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.714032 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.714196 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.714425 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.714610 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.714877 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.715028 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.715202 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.715479 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.715634 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.715779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.716015 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.716182 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.716407 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.716556 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.716730 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.717037 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.717191 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.717336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.717574 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.717726 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.717945 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.718123 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.718294 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.718575 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.718722 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.718868 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.719184 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.719334 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.719499 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.719734 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.719888 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.720634 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.720813 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.720961 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.721251 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.721424 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.721571 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.721960 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.722106 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.722252 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.722409 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.722626 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.722804 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.723005 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.723157 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.723410 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.723571 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.723719 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.724020 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.724169 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.724325 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.724590 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.724757 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.725073 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.725211 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.725546 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.725687 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.725862 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.726179 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.726520 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.726833 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.727212 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.727448 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.727603 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.728004 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.728173 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.728316 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.728576 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.728818 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.729135 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.729365 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.729645 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.729811 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.730017 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.730210 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.730376 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.730739 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.730906 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.731089 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.731309 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.731474 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.731772 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.731933 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.732137 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.732395 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.732545 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.732720 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.733123 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.733280 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.733539 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.733887 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.734039 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.734340 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.734646 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.734796 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.734986 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.735132 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.735311 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.735678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.736590 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.736590 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.737367 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.737513 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.737659 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.737659 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.737941 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.738099 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.738242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.738386 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.738764 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.738926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.739116 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.739436 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.739717 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.739871 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.740114 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.740262 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.740470 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.740799 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.740980 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.741237 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.741487 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.741641 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.741897 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.742071 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.742385 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.742759 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.742923 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.743103 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.743237 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.743428 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.743799 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.743951 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.744116 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.744398 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.744563 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.744821 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.744972 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.745174 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.745423 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.745578 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.745848 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.745999 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.746144 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.746461 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.746633 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.746834 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.747087 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.747225 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.747463 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.747671 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.747827 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.748141 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.748441 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.748597 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.748841 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.749006 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.749150 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.749517 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.749686 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.749822 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.750137 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.750290 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.751189 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.751376 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.751525 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.751525 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.751814 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.751960 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.752200 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.752516 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.752721 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.753032 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.753203 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.753360 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.753776 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.753930 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.754261 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.754410 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.754717 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.754931 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.755200 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.755541 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.755724 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.755898 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.756162 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.756418 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.756575 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.757042 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.757198 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.757516 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.757720 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.757873 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.758171 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.758377 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.758627 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.758898 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.759115 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.759313 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.759462 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.759605 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.759774 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.759929 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.760059 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.760330 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.760481 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.760624 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.760934 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.761087 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.761233 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.761471 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.761626 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.761878 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.762040 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.762214 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.762517 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.762672 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.762911 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.763046 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.763235 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.763531 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.763748 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.763899 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.764078 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.764227 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.764508 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.764733 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.764887 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.765156 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.765298 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.765516 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.765716 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.765907 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.766070 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.766298 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.766448 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.766904 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.767074 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.767448 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.767750 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.767967 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.768147 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.768428 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.768597 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.768920 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.769117 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.769268 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.769539 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.769954 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.770106 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.770301 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.770443 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.770653 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.770817 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.770976 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.771120 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.771362 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.771584 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.771857 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.772083 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.772313 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.772628 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.772782 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.773124 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.773336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.773541 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.773787 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.773973 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.774243 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.774411 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.774626 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.774825 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.774979 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.775262 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.775398 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.775579 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.775808 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.775987 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.776204 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.776371 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.776764 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.776916 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.777109 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.777310 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.777461 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.777737 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.777897 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.778037 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.778302 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.778473 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.778790 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.778942 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.779086 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.779362 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.779532 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.779674 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.779893 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.780030 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.780349 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.780503 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.781089 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.781243 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.781482 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.781629 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.781854 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.782102 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.782271 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.783023 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.783177 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.783369 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.783684 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.783905 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.784054 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.784241 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.784376 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.784704 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.784859 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.785128 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.785323 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.785475 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.785786 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.785942 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.786139 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.786377 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.786706 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.786874 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.787017 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.787146 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.787440 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.787605 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.787942 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.788111 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.789203 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.789530 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.789685 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.789685 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.790021 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.790167 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.790167 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.790418 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.790642 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.790932 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.791074 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.791436 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.791635 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.791768 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.791974 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.792115 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.792451 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.792644 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.792958 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.793118 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.793266 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.793496 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.793663 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.793888 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.794164 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.794312 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.794574 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.794725 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.794902 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.795127 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.795360 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.795506 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.795689 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.795842 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.796046 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.796238 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.796393 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.796703 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.796856 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.797015 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.797264 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.797413 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.797616 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.797779 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.797926 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.799024 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.799203 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.799353 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.799552 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.799701 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.799928 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.800229 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.800401 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.800549 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.800765 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.800920 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.801196 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.801362 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.801497 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.801858 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.802027 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.802249 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.802464 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.802670 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.802920 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.803056 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.803349 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.803619 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.803959 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.804252 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.804402 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.804656 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.804966 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.805122 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.805391 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.805600 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.805761 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.806085 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.806236 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.806420 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.806671 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.806841 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.807118 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.807269 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.807417 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.807690 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.807845 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.808051 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.808310 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.808465 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.808831 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.808983 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.809183 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.809373 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.809527 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.809844 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.810013 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.810235 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.810570 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.810792 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.810920 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.811034 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.811225 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.811558 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.811718 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.811882 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.812147 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.812313 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.812629 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.812780 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.812912 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.813172 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.813308 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.813551 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.813927 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.814247 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.814544 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.814686 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.814938 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.815090 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.815266 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.815567 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.815724 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.815866 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.816097 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.816253 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.816547 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.816688 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.816920 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.817068 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.817454 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.817622 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.817902 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.818069 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.818228 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.818465 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.818711 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.818927 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.819076 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.819207 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.819510 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.819665 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.819847 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.820078 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.820233 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.820482 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.820615 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.820798 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.821256 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.821482 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.821631 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.821757 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.821888 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.822203 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.822375 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.822637 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.822846 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.823002 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.823134 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.823403 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.823538 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.823769 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.823989 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.824141 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.824362 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.824533 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.824685 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.825017 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.825187 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.825334 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.825613 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.825784 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.825961 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.826173 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.826313 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.826620 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.826774 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.826972 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.827221 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.827362 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.827579 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.827729 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.827886 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.828199 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.828362 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.828494 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.828733 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.828905 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.829102 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.829285 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.829606 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.829824 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.830176 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.830176 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.830425 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.830598 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.830796 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.830928 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.831135 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.831397 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.831558 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.831768 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.831949 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.832100 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.832441 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.832611 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.832779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.833002 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.833156 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.833470 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.833621 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.833826 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.834023 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.834181 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.834582 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.834797 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.834974 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.835145 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.835324 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.835636 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.835881 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.836129 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.836287 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.836503 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.836690 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.836911 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.837143 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.837290 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.837475 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.837756 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.837910 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.838109 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.838297 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.838449 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.838776 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.838926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.839084 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.839338 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.839505 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.839717 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.839895 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.840042 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.840355 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.840511 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.840716 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.840923 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.841089 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.841382 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.841538 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.841931 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.842106 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.842429 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.842728 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.842875 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.843013 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.843158 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.843400 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.843562 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.843721 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.844002 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.844157 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.844356 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.844548 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.844759 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.845639 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.845929 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.846084 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.846334 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.846785 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.846936 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.847174 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.847327 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.847567 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.847806 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.847974 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.848288 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.848442 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.848590 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106477) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 17:16:46.848822 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.849247 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.849703 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.850129 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.850595 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.851147 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.851597 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.852015 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.852443 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.852860 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.853269 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.853685 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.854118 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.854567 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.854975 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.855383 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.855837 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.856246 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.856695 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.857262 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.857679 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.858085 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.858665 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.859105 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.859594 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.860033 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.860458 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.861447 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.862053 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.862472 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.862915 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.863461 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.863892 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.864316 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.864735 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.865145 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.865624 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.866057 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.866510 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.866969 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.867511 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.867935 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.868356 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.868780 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.869209 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.869618 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.870058 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.870599 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.871019 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.871439 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.871942 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.872351 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.872768 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.873187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.873651 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.874058 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.874462 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.874944 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.875351 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.875786 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.876213 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.877151 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.877574 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.877982 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.878406 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.878859 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.879267 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.879682 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.880116 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.880574 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.880984 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.881416 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.881851 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.882285 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.882768 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.883213 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.883643 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.884077 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.884495 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.884922 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.885336 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.885748 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.886169 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.886634 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.887043 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.887454 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.887911 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.888370 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.888788 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.889193 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.889618 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.890031 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.890455 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.890908 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.891330 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.891739 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.892733 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.893190 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.893593 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.894021 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.894473 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.895010 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.895431 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.895861 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.896281 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.896707 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.897132 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.897551 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.897967 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.898848 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.899928 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.900371 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.900799 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.901484 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.901916 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.902334 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.902913 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.903346 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.903763 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.904180 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.904598 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.905016 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.905441 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.906123 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.906636 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.907065 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.907520 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.908029 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.908478 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.908892 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.909314 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.909733 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.910206 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.910698 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.911129 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.911554 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.911973 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.912391 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.912920 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.913370 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.913833 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.914283 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.914755 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.915172 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.915615 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.916062 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.916504 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.916972 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.917423 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.917841 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.918260 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.918828 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.919586 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.920089 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.920541 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.921056 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.921491 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.921945 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.922363 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.922877 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.923319 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.923728 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.924161 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.924576 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.924983 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.925414 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.925827 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.926310 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.926852 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.927265 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.927974 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.928435 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.928856 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.929291 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.929725 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.930146 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.930603 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.931032 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.931454 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.931870 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.932294 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.932709 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.933183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.933767 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.934177 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.934647 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.935058 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.935475 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.935882 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.936316 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.936723 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.937175 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.937584 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.938007 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.938413 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.939465 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.939878 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.940295 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.940739 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.941171 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.941587 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.942002 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.942429 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.942911 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.943460 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.943895 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.944324 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.944804 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.945264 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.945700 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.946139 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.946615 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.947036 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.947454 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.948030 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.948453 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.949157 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.949626 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.950091 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.950575 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.951021 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.951459 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.951908 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.952317 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.952749 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.953172 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.953587 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.954043 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.955142 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.955569 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.955982 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.956408 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.956823 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.957236 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.957656 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.958071 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.958519 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.959013 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.959473 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.959905 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.960378 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.960807 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.961236 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.961654 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.962078 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.962518 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.962949 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.963363 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.963786 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.964206 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.964671 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.965087 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.965501 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.966042 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.966560 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.966998 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.967422 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.967941 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.968373 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.968808 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.969221 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.969653 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.970101 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.970674 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.971207 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.971653 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.972156 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.972594 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.973002 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.973409 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.973825 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.974252 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.974731 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.975174 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.975581 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.975997 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.976420 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.976829 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.977236 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.977672 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.978340 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.978731 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.979158 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.979566 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.980256 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.980859 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.981140 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.981560 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.981979 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.982387 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.982831 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.983241 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.983677 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.984140 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.984617 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.985039 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.985468 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.986092 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.986644 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.987069 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.987520 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.987945 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.988398 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.988821 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.989259 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.989683 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.990109 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.990657 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.991081 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.991586 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.991980 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.992452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.992880 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.993297 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.993754 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.994177 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.994655 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.995112 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.995527 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.995968 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.996451 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.996866 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.997287 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.997711 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.998127 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.998615 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.999029 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.999442 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:46.999877 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:47.000328 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:47.000764 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:47.001905 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:47.002383 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:47.002893 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:47.003330 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:47.003880 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:47.005524 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:47.005988 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:47.006420 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:47.006898 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:47.007316 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:47.007723 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:16:47.008068 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106478) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 17:16:47.011471 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO dbcounter [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Registered counter for database nova_api Aug 22 17:16:47.037563 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_db.sqlalchemy.engines [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:16:47.045477 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writer thread running {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:16:47.112467 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.context [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c1085d9-5546-41ae-9dbb-982f7045f223(cell1) {{(pid=106477) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 17:16:47.116602 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:47.117095 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:47.118936 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:47.119868 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:47.120338 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:47.122622 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:47.125143 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO dbcounter [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Registered counter for database nova_cell0 Aug 22 17:16:47.132441 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO dbcounter [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Registered counter for database nova_cell1 Aug 22 17:16:47.142537 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_db.sqlalchemy.engines [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:16:47.145007 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_db.sqlalchemy.engines [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:16:47.154071 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writer thread running {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:16:47.154556 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writer thread running {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:16:47.179256 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO dbcounter [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] Registered counter for database nova_api Aug 22 17:16:47.202992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG oslo_db.sqlalchemy.engines [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:16:47.211516 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG dbcounter [-] [106478] Writer thread running {{(pid=106478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:16:47.274354 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.context [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c1085d9-5546-41ae-9dbb-982f7045f223(cell1) {{(pid=106478) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 17:16:47.278841 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG oslo_concurrency.lockutils [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:47.279418 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG oslo_concurrency.lockutils [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:47.281382 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG oslo_concurrency.lockutils [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:47.282292 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG oslo_concurrency.lockutils [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:16:47.283483 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG oslo_concurrency.lockutils [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:16:47.285892 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG oslo_concurrency.lockutils [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106478) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:16:47.288239 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO dbcounter [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] Registered counter for database nova_cell0 Aug 22 17:16:47.294685 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO dbcounter [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] Registered counter for database nova_cell1 Aug 22 17:16:47.304721 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG oslo_db.sqlalchemy.engines [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:16:47.306300 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG oslo_db.sqlalchemy.engines [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:16:47.311878 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO dbcounter [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Registered counter for database nova_cell0 Aug 22 17:16:47.314906 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG dbcounter [-] [106478] Writer thread running {{(pid=106478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:16:47.316846 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG dbcounter [-] [106478] Writer thread running {{(pid=106478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:16:47.324035 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_db.sqlalchemy.engines [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106477) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:16:47.330172 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writer thread running {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:16:47.472212 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO dbcounter [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] Registered counter for database nova_cell0 Aug 22 17:16:47.484239 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG oslo_db.sqlalchemy.engines [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106478) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:16:47.490141 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG dbcounter [-] [106478] Writer thread running {{(pid=106478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:16:47.857541 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: WARNING keystonemiddleware.auth_token [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 17:16:47.865725 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: WARNING keystonemiddleware.auth_token [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 17:16:47.878877 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: WARNING keystonemiddleware.auth_token [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 17:16:47.886746 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: WARNING keystonemiddleware.auth_token [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 17:16:48.227254 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: WARNING keystonemiddleware.auth_token [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 17:16:48.234016 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: WARNING keystonemiddleware.auth_token [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 17:16:48.240148 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e308d479c0 pid: 106477 (default app) Aug 22 17:16:48.242609 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:16:48.243971 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002157 Aug 22 17:16:48.244510 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Mon Aug 22 17:16:48 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:16:48.248811 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: WARNING keystonemiddleware.auth_token [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 17:16:48.258401 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: WARNING keystonemiddleware.auth_token [None req-78daf7bf-cb5d-4455-b1ea-278174be08e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 17:16:48.266743 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e308d479c0 pid: 106478 (default app) Aug 22 17:18:28.320305 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:28.322103 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002158 Aug 22 17:18:28.322560 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 22 17:18:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:18:28.337044 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG dbcounter [-] [106478] Writing DB stats nova_api:SELECT=3 {{(pid=106478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:28.338675 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG dbcounter [-] [106478] Writing DB stats nova_cell0:SELECT=3 {{(pid=106478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:28.340860 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG dbcounter [-] [106478] Writing DB stats nova_cell1:SELECT=3 {{(pid=106478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:28.342259 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG dbcounter [-] [106478] Writing DB stats nova_cell0:SELECT=3 {{(pid=106478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:29.724518 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-3b0b798d-33bd-48be-b93a-d2e57e11e7a4 admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:29.767082 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-3b0b798d-33bd-48be-b93a-d2e57e11e7a4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.435844 Aug 22 17:18:29.768373 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 22 17:18:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:33.013170 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:33.014219 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-1a77f781-8b69-4d4e-8d0c-367a15ae722b None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 22 17:18:33.019674 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 22 17:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:18:33.957482 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-680c9fee-69d0-45f5-96a0-104958599c0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 1}} {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:33.996450 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:18:33.996450 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: warnings.warn(msg) Aug 22 17:18:34.143121 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-680c9fee-69d0-45f5-96a0-104958599c0c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 1.120624 Aug 22 17:18:34.144063 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 22 17:18:33 2022] POST /compute/v2.1/flavors => generated 407 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:18:34.491514 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-dbe5bbac-3312-4026-905d-03bfbd06249d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:34.496739 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:18:34.496739 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: warnings.warn(msg) Aug 22 17:18:34.499796 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writing DB stats nova_api:SELECT=3 {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:34.500633 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writing DB stats nova_cell1:SELECT=3 {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:34.501659 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writing DB stats nova_cell0:SELECT=3 {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:34.502385 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:18:34.666740 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-dbe5bbac-3312-4026-905d-03bfbd06249d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.507650 Aug 22 17:18:34.667776 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 22 17:18:34 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:37.345502 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-680c9fee-69d0-45f5-96a0-104958599c0c admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:37.347268 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-680c9fee-69d0-45f5-96a0-104958599c0c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002238 Aug 22 17:18:37.347719 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 22 17:18:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:38.228308 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-46145eb3-710b-4ca8-9105-3cc2aea26bc1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "ram": 512, "vcpus": 1, "disk": 5, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:38.259034 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:18:38.259034 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: warnings.warn(msg) Aug 22 17:18:38.353682 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-46145eb3-710b-4ca8-9105-3cc2aea26bc1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.998587 Aug 22 17:18:38.358431 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 22 17:18:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:18:38.369651 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-36cc2bae-e97a-49ff-942d-03ae5a5c5a89 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:38.373650 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:18:38.373650 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: warnings.warn(msg) Aug 22 17:18:38.478634 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-36cc2bae-e97a-49ff-942d-03ae5a5c5a89 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113126 Aug 22 17:18:38.479832 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 22 17:18:38 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:18:41.803643 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-46145eb3-710b-4ca8-9105-3cc2aea26bc1 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:41.804662 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-46145eb3-710b-4ca8-9105-3cc2aea26bc1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 22 17:18:41.805082 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 22 17:18:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:42.369366 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-c098e539-7bd9-4994-84bb-a182f615c96c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "disk": 10, "swap": 0, "name": "ds1G", "id": "d2", "os-flavor-access:is_public": true, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:42.491556 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-c098e539-7bd9-4994-84bb-a182f615c96c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.678598 Aug 22 17:18:42.492852 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 22 17:18:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:18:42.507510 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-27a617d0-fa46-4627-80ef-78dbd08f509b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:42.663025 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-27a617d0-fa46-4627-80ef-78dbd08f509b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.159400 Aug 22 17:18:42.663999 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 22 17:18:42 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:18:45.477839 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-c098e539-7bd9-4994-84bb-a182f615c96c admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:45.477839 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-c098e539-7bd9-4994-84bb-a182f615c96c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001653 Aug 22 17:18:45.483600 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 22 17:18:45 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:46.122798 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-4e522e5d-b64a-41b0-96e6-4c1a28ad3abd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "id": "d3", "name": "ds2G", "rxtx_factor": 1.0, "vcpus": 2, "ram": 2048, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:46.211342 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-4e522e5d-b64a-41b0-96e6-4c1a28ad3abd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.719240 Aug 22 17:18:46.212746 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 22 17:18:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:18:46.227534 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-e2cf7caa-b12c-4b8a-8828-4b5101295714 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:46.310771 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-e2cf7caa-b12c-4b8a-8828-4b5101295714 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087319 Aug 22 17:18:46.311631 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 22 17:18:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:18:49.255469 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-4e522e5d-b64a-41b0-96e6-4c1a28ad3abd admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:49.257394 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-4e522e5d-b64a-41b0-96e6-4c1a28ad3abd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002379 Aug 22 17:18:49.258288 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 22 17:18:49 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:49.811389 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-37483211-e3bf-4078-977d-a25cd77e193e admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "name": "ds4G", "disk": 20, "id": "d4", "rxtx_factor": 1.0}} {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:49.892195 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-37483211-e3bf-4078-977d-a25cd77e193e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.622863 Aug 22 17:18:49.902553 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 22 17:18:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:18:49.918109 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-925ac010-bfff-48d3-94df-aa45dc0e15c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:50.004258 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-925ac010-bfff-48d3-94df-aa45dc0e15c0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097274 Aug 22 17:18:50.006184 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Mon Aug 22 17:18:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:18:52.901823 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-37483211-e3bf-4078-977d-a25cd77e193e admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:52.902909 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-37483211-e3bf-4078-977d-a25cd77e193e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001820 Aug 22 17:18:52.903338 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 22 17:18:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:53.785187 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-a2cd35c3-5bc3-400a-9eef-e8b61e515201 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:53.827839 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-a2cd35c3-5bc3-400a-9eef-e8b61e515201 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.917022 Aug 22 17:18:53.828591 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 22 17:18:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:18:56.918503 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-37483211-e3bf-4078-977d-a25cd77e193e admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:18:56.920311 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-37483211-e3bf-4078-977d-a25cd77e193e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002582 Aug 22 17:18:56.921045 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 22 17:18:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:18:57.494030 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-41df0f2c-df73-4878-abd4-cbc384d4af3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "id": "1", "os-flavor-access:is_public": true}} {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:57.611808 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-41df0f2c-df73-4878-abd4-cbc384d4af3c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.680069 Aug 22 17:18:57.612297 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 22 17:18:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:18:57.625763 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-ea7ed96d-304f-4e51-9308-f157af09f966 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:18:57.730184 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-ea7ed96d-304f-4e51-9308-f157af09f966 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108315 Aug 22 17:18:57.731048 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 22 17:18:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:19:00.670079 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-41df0f2c-df73-4878-abd4-cbc384d4af3c admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:00.671257 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-41df0f2c-df73-4878-abd4-cbc384d4af3c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001638 Aug 22 17:19:00.671766 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 22 17:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:01.324654 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-e48dabf1-2ede-4375-a8c3-f525faebd2be admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "id": "2", "swap": 0}} {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:01.334840 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG dbcounter [-] [106478] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=6,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:01.470351 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-e48dabf1-2ede-4375-a8c3-f525faebd2be admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.790528 Aug 22 17:19:01.471108 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 22 17:19:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:19:01.488920 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-5e1836e2-3761-4608-870f-0ce3c43ace8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:01.631891 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-5e1836e2-3761-4608-870f-0ce3c43ace8a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.148121 Aug 22 17:19:01.633277 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 22 17:19:01 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:04.434071 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-e48dabf1-2ede-4375-a8c3-f525faebd2be admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:04.435943 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-e48dabf1-2ede-4375-a8c3-f525faebd2be admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002256 Aug 22 17:19:04.436773 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 22 17:19:04 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:05.092140 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-5aebe0f7-8119-4929-b292-f069f7c5dee9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "ram": 4096, "disk": 40, "rxtx_factor": 1.0, "name": "m1.medium", "swap": 0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:05.108647 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writing DB stats nova_api:SELECT=36,nova_api:SAVEPOINT=4,nova_api:INSERT=7,nova_api:RELEASE=4 {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:05.251292 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-5aebe0f7-8119-4929-b292-f069f7c5dee9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.807533 Aug 22 17:19:05.253017 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 22 17:19:04 2022] POST /compute/v2.1/flavors => generated 406 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:19:05.274323 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-0db287d6-9382-456e-ba9b-2d35480be840 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:05.397830 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-0db287d6-9382-456e-ba9b-2d35480be840 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129544 Aug 22 17:19:05.399268 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 22 17:19:05 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:08.370104 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-5aebe0f7-8119-4929-b292-f069f7c5dee9 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:08.371885 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-5aebe0f7-8119-4929-b292-f069f7c5dee9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002730 Aug 22 17:19:08.372601 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 22 17:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:09.196396 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-5011c4a0-5e0e-43cc-9553-cc233737ec9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4", "name": "m1.large", "swap": 0, "os-flavor-access:is_public": true, "disk": 80, "rxtx_factor": 1.0, "ram": 8192}} {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:10.015693 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-5011c4a0-5e0e-43cc-9553-cc233737ec9f admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.632079 Aug 22 17:19:10.016804 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 22 17:19:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1634 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:19:10.035431 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-3b7eeed7-4d02-41e9-a99f-f412fd496438 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:10.216568 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-3b7eeed7-4d02-41e9-a99f-f412fd496438 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.190266 Aug 22 17:19:10.217610 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 22 17:19:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:19:13.087660 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-5011c4a0-5e0e-43cc-9553-cc233737ec9f admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:13.089412 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-5011c4a0-5e0e-43cc-9553-cc233737ec9f admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002710 Aug 22 17:19:13.090093 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 22 17:19:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:19:13.686639 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-977bdb92-1916-48af-bed5-3e0326c30026 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "name": "m1.xlarge"}} {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:13.805289 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-977bdb92-1916-48af-bed5-3e0326c30026 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.703924 Aug 22 17:19:13.805865 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Mon Aug 22 17:19:13 2022] POST /compute/v2.1/flavors => generated 408 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:19:13.818858 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-99d7919e-20b8-4f81-b6be-73883b1a5c54 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:13.907589 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-99d7919e-20b8-4f81-b6be-73883b1a5c54 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092441 Aug 22 17:19:13.908690 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Mon Aug 22 17:19:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:19:33.896289 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-977bdb92-1916-48af-bed5-3e0326c30026 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:33.897354 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-977bdb92-1916-48af-bed5-3e0326c30026 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 22 17:19:33.897771 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 22 17:19:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:33.910057 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG dbcounter [-] [106478] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=17,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=106478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:34.391670 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-766f3333-ef41-421e-bad9-046d2e5d79f9 admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:34.412886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-766f3333-ef41-421e-bad9-046d2e5d79f9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.507269 Aug 22 17:19:34.413493 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 22 17:19:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:19:35.580187 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-977bdb92-1916-48af-bed5-3e0326c30026 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:35.581328 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-977bdb92-1916-48af-bed5-3e0326c30026 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Aug 22 17:19:35.581794 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 22 17:19:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:19:36.310352 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-e552ea04-c140-423e-8f93-7d40869854c6 admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:36.320910 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.wsgi [None req-e552ea04-c140-423e-8f93-7d40869854c6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-e552ea04-c140-423e-8f93-7d40869854c6 admin admin] Request method failure captured: Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Accept: application/json Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Accept-Encoding: gzip, deflate Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Connection: keep-alive Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Content-Length: 0 Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Host: 10.222.0.20 Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Openstack-Api-Version: compute 2.90 Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Openstack-System-Scope: None Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: User-Agent: python-novaclient Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Auth-Token: gAAAAABjA7qncEBCW5aYDwffdDDu5ezATtuKqKpTzMjSVzPM9Vg_dJiFUBwvmMqCJ_GT3u9CeUH1X1BznpeZiGJVJgvqsAuxOpSDJ6iJGYfrHtdQqf3tZOLjDRitJ64AwjRaaJT5V3fD1emdkpTSYtevEXsCiSCWjSliFZ7H4i6eeADsRWrVl4o Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Domain-Id: None Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Domain-Name: None Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Identity-Status: Confirmed Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Is-Admin-Project: True Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Project-Domain-Id: default Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Project-Domain-Name: Default Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Project-Id: 14e122ee73be44deb3dfe27923205d92 Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Project-Name: admin Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Role: reader,member,admin Aug 22 17:19:36.327181 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Roles: reader,member,admin Aug 22 17:19:36.328926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14e122ee73be44deb3dfe27923205d92", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:19:36.328926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Tenant: admin Aug 22 17:19:36.328926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Tenant-Id: 14e122ee73be44deb3dfe27923205d92 Aug 22 17:19:36.328926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Tenant-Name: admin Aug 22 17:19:36.328926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User: admin Aug 22 17:19:36.328926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User-Domain-Id: default Aug 22 17:19:36.328926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User-Domain-Name: Default Aug 22 17:19:36.328926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User-Id: b8814a79ac534e6e8b81d70404045912 Aug 22 17:19:36.328926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User-Name: admin Aug 22 17:19:36.328926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: method: > Aug 22 17:19:36.328926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: exception: Flavor 42 could not be found. Aug 22 17:19:36.328926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: action_args: {'id': '42'} Aug 22 17:19:36.328926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:36.328926 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:36.329886 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:36.331242 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-e552ea04-c140-423e-8f93-7d40869854c6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:36.332531 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-e552ea04-c140-423e-8f93-7d40869854c6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.603930 Aug 22 17:19:36.332531 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 22 17:19:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 606 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:36.341958 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-18bc50cc-36bb-4e3c-9e5c-2a51844b274f admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:36.346571 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=11,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:19:36.368156 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-18bc50cc-36bb-4e3c-9e5c-2a51844b274f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030044 Aug 22 17:19:36.368799 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 22 17:19:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:19:36.381992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-be09074a-e053-4907-87a8-08c4343534dc admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:36.408371 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-be09074a-e053-4907-87a8-08c4343534dc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030205 Aug 22 17:19:36.408981 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 22 17:19:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:19:36.419789 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-edee5301-73eb-44a4-950e-a8c2c5b9d515 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:36.426387 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.wsgi [None req-edee5301-73eb-44a4-950e-a8c2c5b9d515 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-edee5301-73eb-44a4-950e-a8c2c5b9d515 admin admin] Request method failure captured: Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Accept: application/json Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Accept-Encoding: gzip, deflate Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Connection: keep-alive Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Content-Length: 0 Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Host: 10.222.0.20 Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Openstack-Api-Version: compute 2.90 Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Openstack-System-Scope: None Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: User-Agent: python-novaclient Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Auth-Token: gAAAAABjA7qncEBCW5aYDwffdDDu5ezATtuKqKpTzMjSVzPM9Vg_dJiFUBwvmMqCJ_GT3u9CeUH1X1BznpeZiGJVJgvqsAuxOpSDJ6iJGYfrHtdQqf3tZOLjDRitJ64AwjRaaJT5V3fD1emdkpTSYtevEXsCiSCWjSliFZ7H4i6eeADsRWrVl4o Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Domain-Id: None Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Domain-Name: None Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Identity-Status: Confirmed Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Is-Admin-Project: True Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Project-Domain-Id: default Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Project-Domain-Name: Default Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Project-Id: 14e122ee73be44deb3dfe27923205d92 Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Project-Name: admin Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Role: reader,member,admin Aug 22 17:19:36.429779 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Roles: reader,member,admin Aug 22 17:19:36.440443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14e122ee73be44deb3dfe27923205d92", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:19:36.440443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Tenant: admin Aug 22 17:19:36.440443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Tenant-Id: 14e122ee73be44deb3dfe27923205d92 Aug 22 17:19:36.440443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Tenant-Name: admin Aug 22 17:19:36.440443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User: admin Aug 22 17:19:36.440443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User-Domain-Id: default Aug 22 17:19:36.440443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User-Domain-Name: Default Aug 22 17:19:36.440443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User-Id: b8814a79ac534e6e8b81d70404045912 Aug 22 17:19:36.440443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User-Name: admin Aug 22 17:19:36.440443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: method: > Aug 22 17:19:36.440443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: exception: Flavor 42 could not be found. Aug 22 17:19:36.440443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: action_args: {'id': '42'} Aug 22 17:19:36.440443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:36.440443 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:36.442078 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:36.444422 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-edee5301-73eb-44a4-950e-a8c2c5b9d515 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:36.447466 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-edee5301-73eb-44a4-950e-a8c2c5b9d515 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015329 Aug 22 17:19:36.447466 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 22 17:19:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 22 17:19:37.487642 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-be09074a-e053-4907-87a8-08c4343534dc admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:37.488704 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-be09074a-e053-4907-87a8-08c4343534dc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Aug 22 17:19:37.489121 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 22 17:19:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:19:38.137201 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-07b5e287-e949-4fbb-9dd3-cc078e8f4eba admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.wsgi [None req-07b5e287-e949-4fbb-9dd3-cc078e8f4eba admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-07b5e287-e949-4fbb-9dd3-cc078e8f4eba admin admin] Request method failure captured: Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Accept: application/json Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Accept-Encoding: gzip, deflate Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Connection: keep-alive Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Content-Length: 0 Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Host: 10.222.0.20 Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Openstack-Api-Version: compute 2.90 Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Openstack-System-Scope: None Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: User-Agent: python-novaclient Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Auth-Token: gAAAAABjA7qpiTN7DPHx0RSYujxCUES7vYTkYhCWKeVgtcJPmKFeR_BiIOkTUITD1XpMcNsAeYD6qABorfDYYiOCkMaYmSeEQsJybTcqdZVW6M7luFwSMPwykKhRv5sUaIJusMebMZRGgJaj-WPTe-ZPau0TeeAcddT4ek27DSQdFprPiiqcPGw Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Domain-Id: None Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Domain-Name: None Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Identity-Status: Confirmed Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Is-Admin-Project: True Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Project-Domain-Id: default Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Project-Domain-Name: Default Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Project-Id: 14e122ee73be44deb3dfe27923205d92 Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Project-Name: admin Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Role: reader,member,admin Aug 22 17:19:38.152630 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Roles: reader,member,admin Aug 22 17:19:38.154209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14e122ee73be44deb3dfe27923205d92", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:19:38.154209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Tenant: admin Aug 22 17:19:38.154209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Tenant-Id: 14e122ee73be44deb3dfe27923205d92 Aug 22 17:19:38.154209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Tenant-Name: admin Aug 22 17:19:38.154209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User: admin Aug 22 17:19:38.154209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User-Domain-Id: default Aug 22 17:19:38.154209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User-Domain-Name: Default Aug 22 17:19:38.154209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User-Id: b8814a79ac534e6e8b81d70404045912 Aug 22 17:19:38.154209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User-Name: admin Aug 22 17:19:38.154209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: method: > Aug 22 17:19:38.154209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: exception: Flavor 84 could not be found. Aug 22 17:19:38.154209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: action_args: {'id': '84'} Aug 22 17:19:38.154209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:38.154209 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:38.155031 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:38.156090 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-07b5e287-e949-4fbb-9dd3-cc078e8f4eba admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:38.157294 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-07b5e287-e949-4fbb-9dd3-cc078e8f4eba admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.516255 Aug 22 17:19:38.157294 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 22 17:19:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 518 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 22 17:19:38.165993 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-b9e1af7c-faa4-4799-ae1d-c5a0a9d94897 admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:38.184502 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-b9e1af7c-faa4-4799-ae1d-c5a0a9d94897 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022241 Aug 22 17:19:38.185080 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 22 17:19:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:19:38.196586 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-082cf026-febd-45b9-8c81-a217f4cda984 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:38.215786 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-082cf026-febd-45b9-8c81-a217f4cda984 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023837 Aug 22 17:19:38.216411 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 22 17:19:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:19:38.227130 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-e18351f9-cb61-45ed-aa05-a1b9f7feb59d admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:38.234920 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.wsgi [None req-e18351f9-cb61-45ed-aa05-a1b9f7feb59d admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-e18351f9-cb61-45ed-aa05-a1b9f7feb59d admin admin] Request method failure captured: Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Accept: application/json Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Accept-Encoding: gzip, deflate Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Connection: keep-alive Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Content-Length: 0 Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Host: 10.222.0.20 Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Openstack-Api-Version: compute 2.90 Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Openstack-System-Scope: None Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: User-Agent: python-novaclient Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Auth-Token: gAAAAABjA7qpiTN7DPHx0RSYujxCUES7vYTkYhCWKeVgtcJPmKFeR_BiIOkTUITD1XpMcNsAeYD6qABorfDYYiOCkMaYmSeEQsJybTcqdZVW6M7luFwSMPwykKhRv5sUaIJusMebMZRGgJaj-WPTe-ZPau0TeeAcddT4ek27DSQdFprPiiqcPGw Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Domain-Id: None Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Domain-Name: None Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Identity-Status: Confirmed Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Is-Admin-Project: True Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Project-Domain-Id: default Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Project-Domain-Name: Default Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Project-Id: 14e122ee73be44deb3dfe27923205d92 Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Project-Name: admin Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Role: reader,member,admin Aug 22 17:19:38.235183 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Roles: reader,member,admin Aug 22 17:19:38.239415 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14e122ee73be44deb3dfe27923205d92", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:19:38.239415 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Tenant: admin Aug 22 17:19:38.239415 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Tenant-Id: 14e122ee73be44deb3dfe27923205d92 Aug 22 17:19:38.239415 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Tenant-Name: admin Aug 22 17:19:38.239415 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User: admin Aug 22 17:19:38.239415 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User-Domain-Id: default Aug 22 17:19:38.239415 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User-Domain-Name: Default Aug 22 17:19:38.239415 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User-Id: b8814a79ac534e6e8b81d70404045912 Aug 22 17:19:38.239415 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User-Name: admin Aug 22 17:19:38.239415 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: method: > Aug 22 17:19:38.239415 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: exception: Flavor 84 could not be found. Aug 22 17:19:38.239415 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: action_args: {'id': '84'} Aug 22 17:19:38.239415 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:38.239415 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:38.240452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:38.241738 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-e18351f9-cb61-45ed-aa05-a1b9f7feb59d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:38.243460 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-e18351f9-cb61-45ed-aa05-a1b9f7feb59d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.014143 Aug 22 17:19:38.243460 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Mon Aug 22 17:19:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:39.326704 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-082cf026-febd-45b9-8c81-a217f4cda984 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:39.328102 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-082cf026-febd-45b9-8c81-a217f4cda984 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002072 Aug 22 17:19:39.328969 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 22 17:19:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:19:39.963034 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-49bd230f-fc1a-4866-aa22-42acbfdfb65c admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:39.970066 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.wsgi [None req-49bd230f-fc1a-4866-aa22-42acbfdfb65c admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-49bd230f-fc1a-4866-aa22-42acbfdfb65c admin admin] Request method failure captured: Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Accept: application/json Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Accept-Encoding: gzip, deflate Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Connection: keep-alive Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Content-Length: 0 Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Host: 10.222.0.20 Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Openstack-Api-Version: compute 2.90 Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Openstack-System-Scope: None Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: User-Agent: python-novaclient Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Auth-Token: gAAAAABjA7qry0mVZ36qITok_Rrul4CVmCqLYc7s_mWi9Xy9V5PtRWfsRV72Be-kIJ7awe-enyqSqpb9Zr6ADsAzyntugdRNpfWD8O8DbuJabSbxhI_uh_WhhGRa3WqbI6efbvB2Zy3Fz1BnHItv10hEfXgQj8e2juk5srmDLlWz92w77pg8R6A Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Domain-Id: None Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Domain-Name: None Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Identity-Status: Confirmed Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Is-Admin-Project: True Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Project-Domain-Id: default Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Project-Domain-Name: Default Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Project-Id: 14e122ee73be44deb3dfe27923205d92 Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Project-Name: admin Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Role: reader,member,admin Aug 22 17:19:39.971678 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Roles: reader,member,admin Aug 22 17:19:39.973992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14e122ee73be44deb3dfe27923205d92", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:19:39.973992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Tenant: admin Aug 22 17:19:39.973992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Tenant-Id: 14e122ee73be44deb3dfe27923205d92 Aug 22 17:19:39.973992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-Tenant-Name: admin Aug 22 17:19:39.973992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User: admin Aug 22 17:19:39.973992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User-Domain-Id: default Aug 22 17:19:39.973992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User-Domain-Name: Default Aug 22 17:19:39.973992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User-Id: b8814a79ac534e6e8b81d70404045912 Aug 22 17:19:39.973992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: X-User-Name: admin Aug 22 17:19:39.973992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: method: > Aug 22 17:19:39.973992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: exception: Flavor 451 could not be found. Aug 22 17:19:39.973992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: action_args: {'id': '451'} Aug 22 17:19:39.973992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:39.973992 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:39.975320 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: ERROR nova.api.openstack.wsgi Aug 22 17:19:39.977187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-49bd230f-fc1a-4866-aa22-42acbfdfb65c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106478) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:39.978187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-49bd230f-fc1a-4866-aa22-42acbfdfb65c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.502843 Aug 22 17:19:39.978187 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 22 17:19:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 504 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:39.988616 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-ca4a5838-595a-4e39-9a31-340c02e59309 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:40.004741 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-ca4a5838-595a-4e39-9a31-340c02e59309 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019932 Aug 22 17:19:40.005325 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 22 17:19:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:19:40.016278 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-00b0ea65-d137-4cce-9791-2c2e9045e3d1 admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:40.034471 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-00b0ea65-d137-4cce-9791-2c2e9045e3d1 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.022226 Aug 22 17:19:40.035098 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Mon Aug 22 17:19:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:19:40.046523 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-ff2a88c8-d368-4199-8206-678932eaac8f admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:40.052945 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.wsgi [None req-ff2a88c8-d368-4199-8206-678932eaac8f admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-ff2a88c8-d368-4199-8206-678932eaac8f admin admin] Request method failure captured: Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Accept: application/json Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Accept-Encoding: gzip, deflate Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Connection: keep-alive Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Content-Length: 0 Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Host: 10.222.0.20 Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Openstack-Api-Version: compute 2.90 Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Openstack-System-Scope: None Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: User-Agent: python-novaclient Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Auth-Token: gAAAAABjA7qry0mVZ36qITok_Rrul4CVmCqLYc7s_mWi9Xy9V5PtRWfsRV72Be-kIJ7awe-enyqSqpb9Zr6ADsAzyntugdRNpfWD8O8DbuJabSbxhI_uh_WhhGRa3WqbI6efbvB2Zy3Fz1BnHItv10hEfXgQj8e2juk5srmDLlWz92w77pg8R6A Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Domain-Id: None Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Domain-Name: None Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Identity-Status: Confirmed Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Is-Admin-Project: True Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Openstack-Nova-Api-Version: 2.90 Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Project-Domain-Id: default Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Project-Domain-Name: Default Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Project-Id: 14e122ee73be44deb3dfe27923205d92 Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Project-Name: admin Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Role: reader,member,admin Aug 22 17:19:40.054732 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Roles: reader,member,admin Aug 22 17:19:40.056421 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/14e122ee73be44deb3dfe27923205d92"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_14e122ee73be44deb3dfe27923205d92", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:19:40.056421 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Tenant: admin Aug 22 17:19:40.056421 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Tenant-Id: 14e122ee73be44deb3dfe27923205d92 Aug 22 17:19:40.056421 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-Tenant-Name: admin Aug 22 17:19:40.056421 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User: admin Aug 22 17:19:40.056421 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User-Domain-Id: default Aug 22 17:19:40.056421 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User-Domain-Name: Default Aug 22 17:19:40.056421 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User-Id: b8814a79ac534e6e8b81d70404045912 Aug 22 17:19:40.056421 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: X-User-Name: admin Aug 22 17:19:40.056421 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: method: > Aug 22 17:19:40.056421 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: exception: Flavor 451 could not be found. Aug 22 17:19:40.056421 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: action_args: {'id': '451'} Aug 22 17:19:40.056421 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:19:40.056421 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:40.062232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: ERROR nova.api.openstack.wsgi Aug 22 17:19:40.064336 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-ff2a88c8-d368-4199-8206-678932eaac8f admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106477) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:19:40.066232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-ff2a88c8-d368-4199-8206-678932eaac8f admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013997 Aug 22 17:19:40.066232 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 22 17:19:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 22 17:19:41.127467 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-00b0ea65-d137-4cce-9791-2c2e9045e3d1 admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:41.132268 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-00b0ea65-d137-4cce-9791-2c2e9045e3d1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001797 Aug 22 17:19:41.132268 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 22 17:19:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:41.796220 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-8736c396-3ddc-4728-9d6f-a62d83b27dc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:41.889445 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-8736c396-3ddc-4728-9d6f-a62d83b27dc0 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.617222 Aug 22 17:19:41.890390 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 22 17:19:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:19:42.990877 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-00b0ea65-d137-4cce-9791-2c2e9045e3d1 admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:42.992477 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-00b0ea65-d137-4cce-9791-2c2e9045e3d1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Aug 22 17:19:42.992908 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 22 17:19:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:19:43.767764 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-41896b90-5d7b-4963-a139-318be327381c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:43.853093 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-41896b90-5d7b-4963-a139-318be327381c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.717088 Aug 22 17:19:43.853691 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 22 17:19:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:19:44.922455 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-00b0ea65-d137-4cce-9791-2c2e9045e3d1 admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:44.923568 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-00b0ea65-d137-4cce-9791-2c2e9045e3d1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Aug 22 17:19:44.923985 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 22 17:19:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:45.630075 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-8f3fbf06-b5e8-4855-bd16-31fabff33f8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:45.716137 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-8f3fbf06-b5e8-4855-bd16-31fabff33f8b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.649389 Aug 22 17:19:45.717343 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 22 17:19:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:19:46.785293 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-00b0ea65-d137-4cce-9791-2c2e9045e3d1 admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:46.786759 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-00b0ea65-d137-4cce-9791-2c2e9045e3d1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002042 Aug 22 17:19:46.787321 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 22 17:19:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:47.502377 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-392fc000-03e2-4cef-88dd-f5371207fe33 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:19:47.597771 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-392fc000-03e2-4cef-88dd-f5371207fe33 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.664163 Aug 22 17:19:47.598347 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Mon Aug 22 17:19:46 2022] POST /compute/v2.1/flavors => generated 409 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:19:48.684044 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-00b0ea65-d137-4cce-9791-2c2e9045e3d1 admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:48.685111 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-00b0ea65-d137-4cce-9791-2c2e9045e3d1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 22 17:19:48.685576 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 22 17:19:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:19:49.387449 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-4d202ba4-9ee8-48d8-9c7b-24015e9d74fa admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:19:49.410519 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-4d202ba4-9ee8-48d8-9c7b-24015e9d74fa admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.574119 Aug 22 17:19:49.411112 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Mon Aug 22 17:19:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:20:50.560768 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-00b0ea65-d137-4cce-9791-2c2e9045e3d1 admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:50.561772 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-00b0ea65-d137-4cce-9791-2c2e9045e3d1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Aug 22 17:20:50.562264 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Mon Aug 22 17:20:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:20:50.571581 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:51.073652 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-dacf6fe7-6150-4233-b8d1-3b00cb95c296 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:51.100700 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-dacf6fe7-6150-4233-b8d1-3b00cb95c296 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.530601 Aug 22 17:20:51.101739 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Mon Aug 22 17:20:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:20:51.124372 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG dbcounter [-] [106478] Writing DB stats nova_api:SELECT=14 {{(pid=106478) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:20:51.128291 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-28adeedd-53fc-455a-a388-b3e21a090929 admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:51.137452 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-28adeedd-53fc-455a-a388-b3e21a090929 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014745 Aug 22 17:20:51.138196 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Mon Aug 22 17:20:51 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:20:51.154070 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-f4bb05bb-c03f-40c8-b2fc-659e693f3925 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:51.163496 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-f4bb05bb-c03f-40c8-b2fc-659e693f3925 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013273 Aug 22 17:20:51.164083 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Mon Aug 22 17:20:51 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:20:51.177539 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-79911c9f-03aa-4b15-a639-2d3a6a1a62cc admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:51.187807 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-79911c9f-03aa-4b15-a639-2d3a6a1a62cc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014764 Aug 22 17:20:51.189310 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Mon Aug 22 17:20:51 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:20:51.204932 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-f7473bd2-50f6-4b5d-a77b-1beea49e3e15 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:20:51.217954 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-f7473bd2-50f6-4b5d-a77b-1beea49e3e15 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018041 Aug 22 17:20:51.223806 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Mon Aug 22 17:20:51 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:24:16.811210 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-79911c9f-03aa-4b15-a639-2d3a6a1a62cc admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:16.812489 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-79911c9f-03aa-4b15-a639-2d3a6a1a62cc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002228 Aug 22 17:24:16.812925 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 22 17:24:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:24:16.967954 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writing DB stats nova_api:SELECT=6 {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:17.141123 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-35123b98-2d7d-4957-9186-7008d509d252 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:17.143635 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:24:17.143635 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: warnings.warn(msg) Aug 22 17:24:17.144906 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-35123b98-2d7d-4957-9186-7008d509d252 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:17.145393 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-35123b98-2d7d-4957-9186-7008d509d252 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:17.145828 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-35123b98-2d7d-4957-9186-7008d509d252 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:17.146597 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-35123b98-2d7d-4957-9186-7008d509d252 admin admin] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:17.147046 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-35123b98-2d7d-4957-9186-7008d509d252 admin admin] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:17.147463 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-35123b98-2d7d-4957-9186-7008d509d252 admin admin] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:17.189594 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-35123b98-2d7d-4957-9186-7008d509d252 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.223290 Aug 22 17:24:17.193929 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 22 17:24:16 2022] GET /compute/v2.1/os-services => generated 791 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:24:18.070627 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-79911c9f-03aa-4b15-a639-2d3a6a1a62cc admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:18.071656 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-79911c9f-03aa-4b15-a639-2d3a6a1a62cc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002290 Aug 22 17:24:18.072107 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 22 17:24:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:24:18.291772 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-6d964089-8484-4e24-99e0-bf500f478922 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:18.294401 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:24:18.294401 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: warnings.warn(msg) Aug 22 17:24:18.295807 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-6d964089-8484-4e24-99e0-bf500f478922 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:18.296423 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-6d964089-8484-4e24-99e0-bf500f478922 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:18.297139 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-6d964089-8484-4e24-99e0-bf500f478922 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:18.297936 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-6d964089-8484-4e24-99e0-bf500f478922 admin admin] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:18.298444 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-6d964089-8484-4e24-99e0-bf500f478922 admin admin] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:18.298943 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-6d964089-8484-4e24-99e0-bf500f478922 admin admin] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:18.321856 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-6d964089-8484-4e24-99e0-bf500f478922 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.097970 Aug 22 17:24:18.325834 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 22 17:24:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:24:29.671026 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-79911c9f-03aa-4b15-a639-2d3a6a1a62cc admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:29.672522 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-79911c9f-03aa-4b15-a639-2d3a6a1a62cc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001885 Aug 22 17:24:29.673064 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 22 17:24:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:24:29.824598 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writing DB stats nova_cell0:SELECT=4 {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:29.825372 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writing DB stats nova_cell1:SELECT=4 {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:29.826171 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG dbcounter [-] [106477] Writing DB stats nova_api:SELECT=8 {{(pid=106477) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:24:29.902406 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-6e9b75f4-7aec-4228-8832-19c9cfde3aed admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:29.904886 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:24:29.904886 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: warnings.warn(msg) Aug 22 17:24:29.906065 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-6e9b75f4-7aec-4228-8832-19c9cfde3aed admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:29.906606 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-6e9b75f4-7aec-4228-8832-19c9cfde3aed admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:29.907037 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-6e9b75f4-7aec-4228-8832-19c9cfde3aed admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:29.907758 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-6e9b75f4-7aec-4228-8832-19c9cfde3aed admin admin] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:29.908265 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-6e9b75f4-7aec-4228-8832-19c9cfde3aed admin admin] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:29.908684 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-6e9b75f4-7aec-4228-8832-19c9cfde3aed admin admin] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:29.937988 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-6e9b75f4-7aec-4228-8832-19c9cfde3aed admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.118407 Aug 22 17:24:29.938606 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 22 17:24:29 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:24:30.834989 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: DEBUG nova.api.openstack.wsgi [None req-79911c9f-03aa-4b15-a639-2d3a6a1a62cc admin admin] Calling method '>' {{(pid=106478) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:30.837009 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: INFO nova.api.openstack.requestlog [None req-79911c9f-03aa-4b15-a639-2d3a6a1a62cc admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002480 Aug 22 17:24:30.837644 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: [pid: 106478|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Mon Aug 22 17:24:30 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:24:31.045994 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG nova.api.openstack.wsgi [None req-57d4d820-0374-444f-a473-e9fb63f5b576 admin admin] Calling method '>' {{(pid=106477) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:24:31.049285 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 22 17:24:31.049285 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: warnings.warn(msg) Aug 22 17:24:31.050553 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-57d4d820-0374-444f-a473-e9fb63f5b576 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:31.051054 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-57d4d820-0374-444f-a473-e9fb63f5b576 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:31.051471 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-57d4d820-0374-444f-a473-e9fb63f5b576 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:31.052199 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-57d4d820-0374-444f-a473-e9fb63f5b576 admin admin] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:24:31.052644 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-57d4d820-0374-444f-a473-e9fb63f5b576 admin admin] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:24:31.053061 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: DEBUG oslo_concurrency.lockutils [None req-57d4d820-0374-444f-a473-e9fb63f5b576 admin admin] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106477) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:24:31.077365 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: INFO nova.api.openstack.requestlog [None req-57d4d820-0374-444f-a473-e9fb63f5b576 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.092293 Aug 22 17:24:31.077949 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: [pid: 106477|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Mon Aug 22 17:24:30 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:25:32.365048 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: Mon Aug 22 17:25:32 2022 - graceful shutdown triggered... Aug 22 17:25:32.365700 dv-cinder-853941-2-iscsi devstack@n-api.service[106477]: Gracefully killing worker 1 (pid: 106477)... Aug 22 17:25:32.366263 dv-cinder-853941-2-iscsi devstack@n-api.service[106478]: Gracefully killing worker 2 (pid: 106478)... Aug 22 17:25:32.367125 dv-cinder-853941-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 22 17:25:33.366637 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: worker 1 buried after 1 seconds Aug 22 17:25:33.367488 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: worker 2 buried after 1 seconds Aug 22 17:25:33.367488 dv-cinder-853941-2-iscsi devstack@n-api.service[106456]: goodbye to uWSGI. Aug 22 17:25:33.368367 dv-cinder-853941-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 22 17:25:33.369040 dv-cinder-853941-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 22 17:25:33.372411 dv-cinder-853941-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 22 17:25:33.382531 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 22 17:25:33.384555 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 22 17:25:33 2022] *** Aug 22 17:25:33.384555 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 22 17:25:33.384555 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 22 17:25:33.384555 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: nodename: dv-cinder-853941-2-iscsi Aug 22 17:25:33.384555 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: machine: x86_64 Aug 22 17:25:33.384555 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: clock source: unix Aug 22 17:25:33.384555 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: pcre jit disabled Aug 22 17:25:33.384555 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: detected number of CPU cores: 4 Aug 22 17:25:33.384555 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: current working directory: / Aug 22 17:25:33.384555 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: detected binary path: /usr/bin/uwsgi-core Aug 22 17:25:33.384555 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: your processes number limit is 47680 Aug 22 17:25:33.384555 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: your memory page size is 4096 bytes Aug 22 17:25:33.384555 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: detected max file descriptor number: 2048 Aug 22 17:25:33.384555 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: lock engine: pthread robust mutexes Aug 22 17:25:33.386455 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: thunder lock: enabled Aug 22 17:25:33.386455 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 22 17:25:33.386455 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 22 17:25:33.427277 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: Python main interpreter initialized at 0x5625722d09c0 Aug 22 17:25:33.427277 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: python threads support enabled Aug 22 17:25:33.427277 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: your server socket listen backlog is limited to 100 connections Aug 22 17:25:33.427277 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: your mercy for graceful operations on workers is 90 seconds Aug 22 17:25:33.427765 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: mapped 403077 bytes (393 KB) for 2 cores Aug 22 17:25:33.427765 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: *** Operational MODE: preforking *** Aug 22 17:25:33.428023 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: *** uWSGI is running in multiple interpreter mode *** Aug 22 17:25:33.428023 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: spawned uWSGI master process (pid: 121839) Aug 22 17:25:33.428243 dv-cinder-853941-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 22 17:25:33.430537 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: spawned uWSGI worker 1 (pid: 121852, cores: 1) Aug 22 17:25:33.430537 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: spawned uWSGI worker 2 (pid: 121853, cores: 1) Aug 22 17:25:33.430957 dv-cinder-853941-2-iscsi devstack@n-api.service[121839]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 22 17:25:34.134766 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 17:25:34.147087 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 22 17:25:35.375106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:25:35.375106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: from cryptography.utils import int_from_bytes Aug 22 17:25:35.375989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:25:35.375989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: from cryptography.utils import int_from_bytes Aug 22 17:25:35.377258 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:25:35.377258 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: from cryptography.utils import int_from_bytes Aug 22 17:25:35.377258 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 22 17:25:35.377258 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: from cryptography.utils import int_from_bytes Aug 22 17:25:37.979991 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 17:25:37.980887 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 17:25:37.981382 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 17:25:37.981967 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 17:25:37.982400 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 17:25:37.983091 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.983659 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.984209 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.984753 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.985563 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.986102 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.986688 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.987248 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.987803 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.988231 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.988770 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.989328 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853941-2-iscsi {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.989885 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.990407 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.991526 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.992032 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.992559 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.993103 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.993635 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.994552 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.996656 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.996656 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.996656 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.997182 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.997714 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.998190 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.998687 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.999192 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:37.999665 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.000177 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.000811 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853941-2-iscsi {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.001285 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.001756 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.002232 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.002943 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.003410 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.003900 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.004438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.004974 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.005503 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.006054 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.007536 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.007929 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.008278 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.009066 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.009625 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.010168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.010762 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.011319 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.011851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.012301 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.012849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.013440 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.014236 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.014837 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.015275 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.015710 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.016244 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.016772 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.017304 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.017839 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.018413 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.018919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.019453 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.019962 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.020447 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.020917 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.021398 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.021942 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.022539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.023044 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.023894 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.024602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.025044 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.025589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.026215 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.026813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.027355 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.027916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.028475 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.029017 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.029559 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.030094 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.030684 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.031268 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.031803 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.032242 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.032772 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.033309 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.033870 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.034402 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.034971 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.035535 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.036050 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.036597 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.037132 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.037672 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.039051 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.039605 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.040153 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.040692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.041233 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.041779 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.042346 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.042936 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.043479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.044020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.044563 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.045095 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.045640 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.046167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.046710 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.047255 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.047773 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.048285 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.048822 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.049340 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.049855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.050411 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.050935 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.051471 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.052010 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.052532 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.053039 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.053592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.054612 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.055091 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.055553 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.056028 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.056506 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.056994 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.057510 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.058004 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.058519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.059009 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.059483 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.059975 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.060505 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.061053 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.061627 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.062153 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.062744 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.063320 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.063882 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.064425 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.064982 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.065566 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.066110 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.066721 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.067283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.067852 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.068416 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.069044 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.069695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.070284 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.070888 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.071435 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.071979 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.072538 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.073117 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.073684 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.074275 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.074904 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.075477 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.076073 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.076688 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.077246 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.077805 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.078363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.079002 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.079613 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.080186 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.080791 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.081372 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.081955 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.082566 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.083121 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.083666 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.084262 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.085030 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.085618 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.086150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.086759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.087348 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.087937 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.088525 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.089070 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.089651 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.090223 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.090817 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.091290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.091560 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.091867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.092197 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.092557 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.092883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.093209 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.093552 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.093950 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.094269 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.094648 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.094978 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.095303 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.095642 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.095979 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.096758 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.096758 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.096966 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.097393 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.097545 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.097868 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.098189 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.098527 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.098857 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.099194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.099517 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.099838 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.100185 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.101057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.101373 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.101707 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.102223 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.102504 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.102910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.103239 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.103551 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.103867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.104484 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.104484 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.104786 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.105099 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.105411 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.105724 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.106034 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.106378 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.106719 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.107036 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.107352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.107662 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.108017 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.108334 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.108683 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.109032 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.109420 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.109688 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.110007 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.110900 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.110900 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.111081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.111307 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.111628 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.111957 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.112275 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.112686 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.112911 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.113245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.113563 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.113892 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.114203 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.115044 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.115044 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.115208 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.115528 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.115858 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.116977 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.117305 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.117889 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.118153 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.118528 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.118785 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.119119 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.119440 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.119760 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.120298 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.120840 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.121319 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.121652 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.121971 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.122295 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.122807 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.128980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.129501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.129501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.129501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.129501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.129501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.129827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.130264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.130264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.130623 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.130961 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.131272 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.131609 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.131939 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.132242 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.132604 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.132919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.133228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.133554 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.133880 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.134197 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.134553 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.134860 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.135176 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.135505 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.135825 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.136137 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.136454 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.136777 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.137099 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.137414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.137769 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.138082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.138372 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.138714 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.139281 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.139595 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.139918 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.140513 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.140853 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.141179 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.141861 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.141861 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.142178 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.142458 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.142904 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.143354 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.143667 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.143869 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.144177 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.144488 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.144804 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.145113 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.145422 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.145730 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.146044 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.146352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.146691 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.146999 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.147461 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.147884 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.148168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.148402 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.148695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.149053 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.149366 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.149675 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.149984 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.150293 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.150681 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.151062 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.151442 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.152030 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.152238 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.152428 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.152743 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.153073 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.153382 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.153698 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.154010 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.154319 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.154664 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.154974 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.155294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.155609 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.155926 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.156241 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.156550 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.156869 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.157179 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.157501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.157816 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.158125 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.158432 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.158777 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.159091 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.159399 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.159715 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.160102 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.160427 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.160736 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.161045 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.161434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.161668 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.162046 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.162328 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.166194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.166194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.166194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.166194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.166194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.166194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.166194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.166194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.167695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.167695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.167695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.167695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.167695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.167695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.168620 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.168620 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.168620 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.169036 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.169036 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.169366 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.170648 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.170648 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.170648 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.170648 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.171232 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.171423 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.171631 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.173171 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.173171 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.173171 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.173171 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.173900 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.173900 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.174195 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.174336 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.175573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.175573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.175573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.175573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.176308 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.176308 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.176564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.177380 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.177380 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.177707 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.179389 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.179389 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.179389 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.180383 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.180383 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.180383 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.180904 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.180904 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.181196 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.181452 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.182753 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.182753 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.182753 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.182753 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.183453 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.183453 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.183783 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.184820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.184820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.184820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.185911 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.185911 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.185911 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.185911 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.186521 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.186706 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.187310 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.187310 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.187673 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.187919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.188232 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.188553 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.188899 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.189338 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.189652 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.189964 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.190278 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.190614 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.191439 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.191439 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.191749 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.191937 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.192662 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.192662 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.193049 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.193049 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.193399 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.193765 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.194118 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.195629 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.195629 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.195629 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.195629 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.196969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.196969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.196969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.196969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.197600 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.197600 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.198002 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.198002 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.198606 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.198606 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.198932 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.199990 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.199990 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.199990 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.200467 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.200629 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.201174 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.201353 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.201829 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.201962 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.202643 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.202643 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.208496 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.208496 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.208496 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.208496 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.208496 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.208496 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.208496 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.208496 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.209479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.209479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.209479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.209479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.209479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.209479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.209479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.209479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.210874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.210874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.210874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.210874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.211608 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.211608 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.211608 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.212051 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.212206 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.213217 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.213217 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.213217 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.213723 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.213837 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.214126 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.214409 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.214776 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.215064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.215374 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.215689 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.215997 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.216304 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.216609 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.216921 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.217289 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.217600 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.217920 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.218249 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.218582 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.218940 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.219218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.219525 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.219835 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.220148 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.220487 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.220792 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.221129 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.221439 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.221782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.222088 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.222408 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.222765 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.223169 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.223464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.223781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.224111 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.224427 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.224745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.225063 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.225917 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.226587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.226931 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.227251 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.227571 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.227891 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.228210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.228674 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.228911 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.229405 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.229577 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.229831 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.230281 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.230673 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.230842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.231191 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.231514 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.231834 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.232154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.232475 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.232853 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.233179 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.233591 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.233805 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.234109 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.234584 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.234832 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.235147 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.235466 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.235783 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.236100 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.236415 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.236731 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.237051 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.237385 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.237725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.238106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.238369 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.238731 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.247851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.247851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.247851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.247851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.247851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.247851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.247851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.247851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.249220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.249220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.249220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.249220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.249220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.249220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.249220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.249220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.250254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.250254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.250254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.250254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.250254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.250254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.250254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.250254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.251175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.251175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.251175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.251175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.251175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.251175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.251175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.251175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.251833 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.251833 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.251833 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.251833 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.252183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.252401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.252733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.253043 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.253351 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.253658 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.253979 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.254358 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.254728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.255001 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.255230 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.255514 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.255867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.256352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.256515 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.256911 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.257373 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.257696 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.258006 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.258340 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.258690 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.259049 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.259377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.259695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.260021 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.260338 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.260653 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.261008 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.261330 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.261916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.262254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.262602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.262980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.263317 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.263621 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.264191 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.264500 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.264835 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.265151 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.265464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.265777 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.266089 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.266400 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.266739 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.267055 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.267364 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.267669 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.267980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.268301 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.268613 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.268967 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.269277 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.269596 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.269952 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.270278 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.270636 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.270945 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.271263 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.271573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.271883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.272249 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.272613 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.272932 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.273266 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.273585 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.273909 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.274347 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.274712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.275038 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.275359 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.275676 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.282847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.283357 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.283357 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.283357 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.283357 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.283357 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.283357 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.283357 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.283357 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.283898 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.283898 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.285459 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.285459 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.285459 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.285459 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.285459 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.285829 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.286240 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.286340 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.287178 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.287178 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.287344 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.287640 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.288500 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.288821 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.289151 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.289490 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.289861 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.290192 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.290560 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.290969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.291314 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.291632 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.292131 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.292365 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.292537 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.292850 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.293164 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.293504 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.293840 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.294150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.294585 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.294824 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.295154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.295475 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.295785 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.296122 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.296435 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.296811 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.297209 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.297507 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.297832 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.298154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.298474 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.298842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.299119 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.299443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.299787 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.300117 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.300433 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.300767 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.301097 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.301458 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.301777 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.302129 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.302462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.302829 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.303148 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.306588 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.306588 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121853) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 17:25:38.369310 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO dbcounter [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] Registered counter for database nova_api Aug 22 17:25:38.393746 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_db.sqlalchemy.engines [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121853) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:25:38.401406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 22 17:25:38.401983 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 22 17:25:38.402216 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 22 17:25:38.402616 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 22 17:25:38.402877 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 22 17:25:38.403276 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.403608 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.403942 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.404262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.404762 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.405089 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.405405 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.405785 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.406113 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.406433 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.406680 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.406973 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853941-2-iscsi {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.407300 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.407611 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.407928 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.408252 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.408558 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.408882 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.409187 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.409703 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.410018 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.410330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.410674 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.411017 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.411332 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.411641 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.411739 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writer thread running {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:25:38.412000 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.412383 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.412640 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.413167 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.413714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853941-2-iscsi {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.414046 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.414358 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.414705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.415139 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.415453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.415769 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.416097 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.416435 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.416753 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.417085 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.417403 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.417725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.418045 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.418347 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.418684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.418999 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.419322 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.419630 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.419939 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.420198 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.420507 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.420830 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.421150 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.421474 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.421726 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.421978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.422294 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.422732 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.422955 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.423357 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.423580 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.423956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.424181 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.424488 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.424795 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.425102 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.425423 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.425741 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.426065 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.426400 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.426714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.427125 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.427377 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.427685 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.428030 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.428350 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.429254 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.429575 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.429897 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.430206 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.430542 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.430857 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.431178 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.431515 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.431823 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.432075 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.432378 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.432686 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.433158 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.433601 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.433767 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.434187 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.434974 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.434974 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.435295 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.435295 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.435742 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.435965 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.436275 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.436589 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.436969 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.437275 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.437671 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.437992 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.438304 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.438641 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.438954 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.439261 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.439586 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.440097 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.440270 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.440591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.440904 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.441808 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.441808 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.442130 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.442288 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.442505 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.442943 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.443252 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.443492 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.443927 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.444858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.445034 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.445337 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.445641 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.445927 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.446236 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.446567 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.446890 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.447184 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.447510 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.447821 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.448130 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.448436 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.448756 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 22 17:25:38.449101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.449434 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.449777 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.450093 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.450428 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.450794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.451114 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.451429 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.451764 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.452125 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.452390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.452701 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.453008 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.453328 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.453647 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.454011 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.454289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.454631 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.455004 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.455256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.459903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.459903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.459903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.459903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.459903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.459903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.459903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.459903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.461088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.461088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.461088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.461088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.461088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.461088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.461088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.461088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.462214 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.462214 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.462214 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.462214 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.462214 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.463757 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.463757 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.463757 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.463757 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.463757 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.464732 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.464732 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.464732 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.465325 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.465325 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.465667 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.465822 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.466010 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.466335 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.466700 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.467014 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.467351 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.467660 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.467976 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.468290 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.468602 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.468908 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.469260 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.469579 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.469884 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.470213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.470556 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.470864 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.471227 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.471541 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.471849 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.472169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.472483 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.472796 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.473111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.473428 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.473760 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.474075 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.474563 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.474732 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.475072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.475539 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.476040 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.476380 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.476702 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.477011 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.477404 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.477716 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.478062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.478318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.478775 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.478958 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.479329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.479644 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.480059 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.480228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.480619 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.480880 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.481189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.481495 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.481804 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.482155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.482463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.482840 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.483180 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.483508 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.483840 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.484158 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.484596 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.484788 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.485107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.485422 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.485743 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.486050 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.486368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.486796 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.487103 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.487441 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.487766 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.488094 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.488403 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.488724 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.489070 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.489934 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.489934 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.490157 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.490333 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.498134 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.498134 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.498134 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.498134 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.498134 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.498134 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.498134 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.498134 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.500081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.500081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.500081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.500081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.500081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.500081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.500081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.500081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.501138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.501138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.501138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.501138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.501138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.501138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.501138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.501138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.502213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.502213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.502213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.502213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.502213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.502213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.502213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.502213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.503323 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.503323 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.503323 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.503323 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.503323 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.503323 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.503323 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.504244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.504244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.504244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.504687 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.504687 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.504983 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.505330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.505794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.505988 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.506309 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.507295 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.507620 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.507979 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.508373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.508746 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.508943 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.509260 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.509572 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.509889 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.510202 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.510553 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.510848 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.511175 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.511487 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.511803 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.512118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.512426 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.512738 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.513058 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.513651 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.514242 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.514660 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.514984 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.515308 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.515629 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.516058 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.516287 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.516632 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.516941 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.517252 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.517560 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.517865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.518178 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.518583 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.518938 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.519109 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.519423 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.519727 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.520031 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.520335 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.520669 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.521005 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.521315 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.521636 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.521942 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.522337 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.522674 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.522981 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.523285 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.523591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.523936 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.524243 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.524584 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.524912 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.525273 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.525762 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.525929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.526309 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.526541 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.526816 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.527124 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.527540 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.527853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.528159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.528630 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.528788 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.529127 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.529392 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.529696 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.530007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.530312 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.530710 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.531013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.531331 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.531563 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.531944 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.532255 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.532561 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.532874 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.533180 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.533498 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.533802 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.534106 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.534410 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.534775 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.535061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.535366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.535696 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.536010 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.536405 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.536616 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.536923 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.537226 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.537586 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.538028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.538366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.538780 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.546022 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.546022 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.546022 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.546022 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.546022 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.546022 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.546022 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.546022 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.547442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.547442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.547442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.547442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.547442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.547442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.547442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.547442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.549169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.549169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.549169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.549169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.549169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.549169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.549169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.549169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.550421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.550421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.550421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.550421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.550421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.550421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.550421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.550421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.551470 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.551470 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.551470 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.551470 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.551470 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.551470 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.551470 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.551470 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.552523 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.552523 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.552523 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.552523 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.553047 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.553047 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.553368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.554830 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.555309 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.555480 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.555805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.556049 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.556386 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.556789 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.557008 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.557319 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.557628 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.557943 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.558250 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.559276 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.559276 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.559598 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.559866 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.560015 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.560232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.560551 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.560903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.561049 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.context [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c1085d9-5546-41ae-9dbb-982f7045f223(cell1) {{(pid=121853) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 17:25:38.561215 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.561652 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.561999 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.562313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.562672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.562980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.563285 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.563600 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.563927 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.564234 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.564542 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.564848 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.565171 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.565479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.565802 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.566231 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.566581 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.567056 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.567336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.567650 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.567961 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.568285 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.568606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.568931 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.570463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.570463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.570793 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.570929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.571174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.571494 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.571803 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.572111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.572431 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.572758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.573037 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:25:38.573199 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.573387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.573817 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.574114 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:25:38.574255 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.574440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.574795 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.575121 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.575428 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.575732 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.576048 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.576355 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.576662 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.577127 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.577284 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.577591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.577898 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.578210 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.578443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:25:38.578630 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.578855 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.579162 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.579466 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.579796 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.580108 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.580434 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.580720 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:25:38.580861 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.581053 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.581377 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.581690 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.581835 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:25:38.582007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.582287 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.582616 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.583061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.583276 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.583604 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.583953 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.584265 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.584576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.585172 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.585394 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.585784 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.586110 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.586437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.586771 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.587294 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.587453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.587685 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.587907 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:25:38.588101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.588363 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.588674 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.588979 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.589284 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.589657 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.589913 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.590223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.590570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.590904 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.591182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.591487 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.591792 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.592139 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.592457 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.592818 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.593134 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.593459 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.593778 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.594095 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.594281 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO dbcounter [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] Registered counter for database nova_cell0 Aug 22 17:25:38.594437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.594813 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.595129 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.595466 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.595815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.596133 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.596452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.596768 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.597090 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.597666 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.597994 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.598311 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.598703 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.599314 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.599831 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.600044 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.600524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.600842 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.601192 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.601509 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.601848 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.602177 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.602526 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.602871 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.603199 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.603515 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.603835 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.604151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.604322 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO dbcounter [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] Registered counter for database nova_cell1 Aug 22 17:25:38.604515 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.604833 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.605141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.605502 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.605771 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.606131 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.606448 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.606787 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.607101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.607677 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.607859 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.608030 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.608616 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.608794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.608978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.609453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.609629 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.610362 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.610601 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.611069 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.611855 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.612041 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.619458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.619458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.619458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.619458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.619458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.619458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.619458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.619458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.621237 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.621237 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.621237 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.621237 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.621237 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.621237 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.621237 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.621237 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.622596 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.622596 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.622596 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.622596 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.622596 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.622596 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.622596 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.622596 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.623948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.623948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.623948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.623948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.623948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.623948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.623948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.623948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.625126 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.625126 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.625126 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.625126 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.625126 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.625126 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.625126 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.626207 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.626207 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.626207 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.626207 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.627122 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.627122 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.627122 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.627568 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.627728 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.627895 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.628668 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_db.sqlalchemy.engines [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121853) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:25:38.628849 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.628849 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.628849 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.629360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.629579 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.629886 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_db.sqlalchemy.engines [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121853) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:25:38.630019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.630591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.630591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.637825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.637825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.637825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.637825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.637825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.637825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.637825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.637825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.640366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.640366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.640366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.640366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.640366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.640366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.640366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.640366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.641805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.641805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.641805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.641805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.641805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.641805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.641805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.641805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.643256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.643256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.643256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.643256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.643256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.643256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.643256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.643256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.644370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.644370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.644370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.644370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.644370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.645577 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writer thread running {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:25:38.645848 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.645848 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.646151 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writer thread running {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:25:38.646300 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.646300 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.646300 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.646300 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.646300 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.646300 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.646300 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.647572 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.647572 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.647572 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.647572 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.648141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.648141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.648966 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.648966 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.649260 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.649415 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.649645 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.649950 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.650254 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.650862 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.651112 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.651334 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.651934 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.651934 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.652312 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.652495 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.652885 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.653175 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.653363 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.653556 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.653855 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.654138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.654451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.654776 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.655155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.655357 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.655655 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.655972 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.656335 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.656642 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.656949 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.657256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.657597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.657932 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.658250 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.658606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.659107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.659325 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.659538 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.659893 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.660217 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.660540 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.660937 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.661182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.661492 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.661804 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.662120 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.662427 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.662766 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.663143 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.663451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.663763 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.664072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.664396 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.664753 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.665076 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.665381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.665693 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.666023 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.666336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.666673 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.666985 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.667299 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.667608 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.667920 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.668229 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.668540 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.668858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.669416 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.669627 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.669794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.670103 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.670429 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.670783 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.671190 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.671443 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.671789 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.672119 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.672435 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.672749 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.673054 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 22 17:25:38.673354 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 22 17:25:38.737230 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO dbcounter [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] Registered counter for database nova_api Aug 22 17:25:38.760058 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_db.sqlalchemy.engines [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:25:38.768135 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writer thread running {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:25:38.830422 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.context [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c1085d9-5546-41ae-9dbb-982f7045f223(cell1) {{(pid=121852) load_cells /opt/stack/nova/nova/context.py:464}} Aug 22 17:25:38.834847 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:25:38.836443 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:25:38.837458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:25:38.838257 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:25:38.838747 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:25:38.840872 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:25:38.843077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO dbcounter [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] Registered counter for database nova_cell0 Aug 22 17:25:38.847755 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO dbcounter [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] Registered counter for database nova_cell1 Aug 22 17:25:38.856819 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_db.sqlalchemy.engines [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:25:38.860539 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_db.sqlalchemy.engines [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:25:38.869755 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writer thread running {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:25:38.880032 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO dbcounter [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] Registered counter for database nova_cell0 Aug 22 17:25:38.890813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_db.sqlalchemy.engines [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121853) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:25:38.895828 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writer thread running {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:25:39.152219 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writer thread running {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:25:39.172964 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO dbcounter [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] Registered counter for database nova_cell0 Aug 22 17:25:39.188037 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_db.sqlalchemy.engines [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 22 17:25:39.196931 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writer thread running {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 22 17:25:39.226749 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: WARNING keystonemiddleware.auth_token [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 17:25:39.234521 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: WARNING keystonemiddleware.auth_token [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 17:25:39.587068 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: WARNING keystonemiddleware.auth_token [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 17:25:39.593219 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: WARNING keystonemiddleware.auth_token [None req-2e640bc8-062c-46ec-825f-b5ba237ed40e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 17:25:39.598721 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5625722d09c0 pid: 121853 (default app) Aug 22 17:25:39.863290 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: WARNING keystonemiddleware.auth_token [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 17:25:39.877471 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: WARNING keystonemiddleware.auth_token [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 17:25:40.323620 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: WARNING keystonemiddleware.auth_token [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 22 17:25:40.329996 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: WARNING keystonemiddleware.auth_token [None req-1492761f-4e49-40c5-84ce-03bd072a4eb0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 22 17:25:40.336517 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5625722d09c0 pid: 121852 (default app) Aug 22 17:26:26.883798 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=3 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:26.884738 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=3 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:26.889567 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=3 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:26.891088 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=3 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:27.238864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e4a7a593-e3fb-4a90-80f7-ae90f742f22b tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] Calling method '.version_select at 0x7f0e5e6631f0>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:28.346031 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e4a7a593-e3fb-4a90-80f7-ae90f742f22b tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/bbe19ec2-bb6f-437d-81e7-3d4202076e24" status: 200 len: 350 microversion: 2.1 time: 1.503296 Aug 22 17:26:28.351651 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 1/1] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 22 17:26:26 2022] GET /compute/v2.1/os-volumes/bbe19ec2-bb6f-437d-81e7-3d4202076e24 => generated 350 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:26:31.244900 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a20c1c0f-f779-460b-8504-24c1f932b756 tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] Calling method '.version_select at 0x7f0e5e7431f0>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:31.326742 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=3 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:31.330992 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=3 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:31.332445 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=3 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:31.338664 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=3 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:31.969122 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a20c1c0f-f779-460b-8504-24c1f932b756 tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f5e16405-8c32-4b2c-89f4-33753eb8efff" status: 200 len: 350 microversion: 2.1 time: 1.072037 Aug 22 17:26:31.970225 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 22 17:26:30 2022] GET /compute/v2.1/os-volumes/f5e16405-8c32-4b2c-89f4-33753eb8efff => generated 350 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:26:36.012697 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-343ceea0-4664-43d5-86f9-16225dd1206b tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] Calling method '.version_select at 0x7f0e5e54b790>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:36.177695 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-343ceea0-4664-43d5-86f9-16225dd1206b tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/1b62c983-069a-49f6-b4b9-879c997804dc" status: 200 len: 350 microversion: 2.1 time: 0.170357 Aug 22 17:26:36.186695 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 22 17:26:36 2022] GET /compute/v2.1/os-volumes/1b62c983-069a-49f6-b4b9-879c997804dc => generated 350 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:26:36.194612 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-713798c0-6690-4feb-af75-e139aeda5dfb tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] Calling method '.version_select at 0x7f0e5e54b1f0>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:36.511722 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-713798c0-6690-4feb-af75-e139aeda5dfb tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.322580 Aug 22 17:26:36.512582 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 3/4] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Aug 22 17:26:36 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:26:36.528254 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5d949fae-7dea-451e-b82a-6f711099a076 tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] Calling method '.version_select at 0x7f0e5e54bf70>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:36.547256 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8e7bf2f7-4f04-4628-91a3-47b8dc9f406e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Action: 'create', calling method: .version_select at 0x7f0e5e529280>, body: {"keypair": {"name": "tempest-keypair-760883869", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7r1E6yzU/+8o7jlGLiyXkKygTkVlGcWZ6eOp8Xqr0U2cV46KACFbhUhC6kCxrqfBMx/RzzBUuoAE122U6bRtmwpINJljxedT0pqRrnrf35aoKK6jrTaNBeAbJuTKMj8g=="}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:26:36.611001 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-8e7bf2f7-4f04-4628-91a3-47b8dc9f406e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for project 6436020e938047408d1f979e23dd48da. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:26:36.621172 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-8e7bf2f7-4f04-4628-91a3-47b8dc9f406e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for user b0db362075b04b2294a6268576a5bba3 and project 6436020e938047408d1f979e23dd48da. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:26:36.802646 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8e7bf2f7-4f04-4628-91a3-47b8dc9f406e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.325289 Aug 22 17:26:36.804292 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 2/5] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 22 17:26:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:26:36.811632 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5d949fae-7dea-451e-b82a-6f711099a076 tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.287853 Aug 22 17:26:36.812823 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 4/6] 10.222.0.20 () {58 vars in 1149 bytes} [Mon Aug 22 17:26:36 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:26:36.831269 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0da5e42a-af5b-4958-a298-827a9321c446 tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] Calling method '.version_select at 0x7f0e5e45b1f0>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:37.072288 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0da5e42a-af5b-4958-a298-827a9321c446 tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.247927 Aug 22 17:26:37.073698 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 3/7] 10.222.0.20 () {58 vars in 1134 bytes} [Mon Aug 22 17:26:36 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:26:37.091918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a1f81273-0d0a-4cab-b03f-6b4e84c6aa34 tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] Calling method '.version_select at 0x7f0e5e4f6790>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:37.306015 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a1f81273-0d0a-4cab-b03f-6b4e84c6aa34 tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.222211 Aug 22 17:26:37.315856 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 5/8] 10.222.0.20 () {58 vars in 1167 bytes} [Mon Aug 22 17:26:37 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:26:37.326764 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-854a0745-3a43-4be7-87b8-832e53d765c8 tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] Calling method '.version_select at 0x7f0e5e45bee0>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:37.616379 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-854a0745-3a43-4be7-87b8-832e53d765c8 tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.297197 Aug 22 17:26:37.629198 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 4/9] 10.222.0.20 () {58 vars in 1170 bytes} [Mon Aug 22 17:26:37 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:26:37.649479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-81270348-0ade-40e1-ae73-a54ce708e27c tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] Calling method '.version_select at 0x7f0e5e4f6940>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:37.873324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-81270348-0ade-40e1-ae73-a54ce708e27c tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.232519 Aug 22 17:26:37.880805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 6/10] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 22 17:26:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:26:37.905559 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-30377be6-2595-4d6c-b2d0-ea37e7ff7553 tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] Calling method '.version_select at 0x7f0e5e486a60>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:38.067712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-30377be6-2595-4d6c-b2d0-ea37e7ff7553 tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.173364 Aug 22 17:26:38.068947 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 5/11] 10.222.0.20 () {58 vars in 1188 bytes} [Mon Aug 22 17:26:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:26:38.087368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9e15f235-769c-42ae-b8bc-31d5fbdc2283 tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] Calling method '.version_select at 0x7f0e5e54b3a0>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:38.487077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9e15f235-769c-42ae-b8bc-31d5fbdc2283 tempest-VolumesTestJSON-1641544174 tempest-VolumesTestJSON-1641544174-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.407201 Aug 22 17:26:38.488382 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1155 bytes} [Mon Aug 22 17:26:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:26:45.826316 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-31be5e98-e8ce-4650-919f-a76d8ef88296 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Action: 'create', calling method: .version_select at 0x7f0e5e4860d0>, body: {"keypair": {"name": "tempest-keypair-962715784", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCt9g8jGPzZI1jRqHscnW+FjqVzN+19uRbovsFReE83zDGGiH3KJ5lfHMTSxHLsY/LWnRUzAKaU6fTpv6EVGcfwo7wGlsw7yC+X0oQvEdo9c3vKPX+Gp2GUzTgfpYdaoOg=="}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:26:45.921548 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-31be5e98-e8ce-4650-919f-a76d8ef88296 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Getting quotas for project c20e7f3aca4c49ae84390a3f1a8ce410. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:26:45.946786 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-31be5e98-e8ce-4650-919f-a76d8ef88296 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Getting quotas for user 864d7f47381e4e4498ad110dbfcfc154 and project c20e7f3aca4c49ae84390a3f1a8ce410. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:26:46.136047 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-31be5e98-e8ce-4650-919f-a76d8ef88296 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.931688 Aug 22 17:26:46.144336 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 6/13] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 22 17:26:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 933 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 17:26:48.399081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-49202608", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:26:48.778164 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.network.neutron [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] validate_networks() for [('4e5a15b8-98bb-4b13-81ee-aec7a6ddff96', None, None, None, None, None)] {{(pid=121852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:26:49.648688 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1123448130", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab7e148b-b163-4e14-9626-bb3c240fc395"}], "security_groups": [{"name": "tempest-securitygroup--388422861"}], "key_name": "tempest-keypair-760883869", "user_data": "}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:26:50.019957 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.network.neutron [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] validate_networks() for [('ab7e148b-b163-4e14-9626-bb3c240fc395', None, None, None, None, None)] {{(pid=121853) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:26:52.134731 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Flavor limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:26:52.135367 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Image limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:26:52.135592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Flavor pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:26:52.136163 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Image pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:26:52.137550 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:26:52.158027 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:52.158844 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:52.161236 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:52.165446 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:52.167910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:52.168438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:52.247240 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for project 6436020e938047408d1f979e23dd48da. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:26:52.252327 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for user b0db362075b04b2294a6268576a5bba3 and project 6436020e938047408d1f979e23dd48da. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:26:52.279411 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Going to run 1 instances... {{(pid=121853) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:26:52.283469 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:26:52.538399 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5418ed1f-029d-4e68-afc7-9d9ff0a7875c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.889634 Aug 22 17:26:52.538399 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 7/14] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:26:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 2900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:26:52.831962 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Flavor limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:26:52.832992 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Image limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:26:52.833640 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Flavor pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:26:52.835184 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Image pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:26:52.836797 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:26:52.883849 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:52.888143 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:52.890022 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:52.892224 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:52.894750 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:52.895900 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:52.985365 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Getting quotas for project de12c2563d50474cac799d50041a2fa0. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:26:52.993681 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Getting quotas for user f46cbc7de18c4f9fb6f54e96be53fea0 and project de12c2563d50474cac799d50041a2fa0. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:26:53.043085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-567151078", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "networks": [{"uuid": "2c78d399-d663-4ab4-9f21-d4bf2f25e0f7"}]}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:26:53.060655 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Going to run 1 instances... {{(pid=121852) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:26:53.063704 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:26:53.176260 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.network.neutron [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] validate_networks() for [('2c78d399-d663-4ab4-9f21-d4bf2f25e0f7', None, None, None, None, None)] {{(pid=121853) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:26:53.372947 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-fbfe6414-c4a7-4458-a82e-885d72dce03c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.230772 Aug 22 17:26:53.374586 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 8/15] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:26:48 2022] POST /compute/v2.1/servers => generated 383 bytes in 5235 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:26:53.403028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-be8ca5bb-9c1e-419c-a15c-76aae12410c5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:53.410158 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-be8ca5bb-9c1e-419c-a15c-76aae12410c5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:26:53.886369 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-be8ca5bb-9c1e-419c-a15c-76aae12410c5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:53.965246 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-be8ca5bb-9c1e-419c-a15c-76aae12410c5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1241 microversion: 2.1 time: 0.588449 Aug 22 17:26:53.980375 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 9/16] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:26:53 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1241 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:26:54.002971 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-fb22584a-f7b4-483f-ac33-19e53a44f5cb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:54.004333 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-fb22584a-f7b4-483f-ac33-19e53a44f5cb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:26:54.166849 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-fb22584a-f7b4-483f-ac33-19e53a44f5cb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:54.187189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-fb22584a-f7b4-483f-ac33-19e53a44f5cb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1220 microversion: 2.1 time: 0.202945 Aug 22 17:26:54.190548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 10/17] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:26:53 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1220 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:26:54.248776 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-413235817", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "537f731f-9768-4793-98dd-71bb11c56034"}], "security_groups": [{"name": "tempest-securitygroup--2022125492"}], "key_name": "tempest-keypair-962715784", "user_data": "}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:26:54.577421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.network.neutron [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] validate_networks() for [('537f731f-9768-4793-98dd-71bb11c56034', None, None, None, None, None)] {{(pid=121852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:26:54.695415 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Flavor limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:26:54.696240 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Image limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:26:54.697251 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Flavor pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:26:54.698411 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Image pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:26:54.699467 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:26:54.734213 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:54.738058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:54.739271 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:54.741732 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:54.745999 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:54.747473 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:54.828677 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Getting quotas for project 778299a985204da18b35d86ed8c4c77d. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:26:54.842472 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Getting quotas for user 9eedc633493b478a9009f7bce07696a8 and project 778299a985204da18b35d86ed8c4c77d. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:26:54.871264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Going to run 1 instances... {{(pid=121853) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:26:54.886664 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:26:55.198798 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1a9cad64-a5a2-46f7-bb36-2065e5f12382 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.660812 Aug 22 17:26:55.206010 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 8/18] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:26:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:26:56.295016 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e2647d15-1f2c-4db4-9d1f-cd2b689d0243 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Action: 'create', calling method: .version_select at 0x7f0e5dbbe550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-176595251", "metadata": {"Type": "work"}}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e2647d15-1f2c-4db4-9d1f-cd2b689d0243 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Request method failure captured: Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 121 Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA7xdfjfrqUxjZlGIlHe2aTwrAamhJ63SPSrK5CbEqCG0JNE0ZLV3HS6VuZMvOWZ2cNzyKkdHz-_CTJFf2G_JXNUf7mYJ3SbJ6p7puOl--cBSP7O4EmND3nOPVnYsxbLPilmiBbQ37kpbiRgwvyQOh8S5jS2eRAhqGbbQ-AoLfqt-BxM Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 0179c56cebe24f9fbe5d907c375f6ab0 Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:26:56.303970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:26:56.305464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0179c56cebe24f9fbe5d907c375f6ab0", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:26:56.305464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:56.305464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 0179c56cebe24f9fbe5d907c375f6ab0 Aug 22 17:26:56.305464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:56.305464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-VolumesNegativeTest-1603114580-project Aug 22 17:26:56.305464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:26:56.305464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:26:56.305464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: 00aefa0efeb54dcb9e21dc1b8a9a26d8 Aug 22 17:26:56.305464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-VolumesNegativeTest-1603114580-project Aug 22 17:26:56.305464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Aug 22 17:26:56.305464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-176595251", "metadata": {"Type": "work"}}} Aug 22 17:26:56.305464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: Aug 22 17:26:56.305464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-176595251', 'metadata': {'Type': 'work'}}}} Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi '#$%' Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:26:56.306434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:26:56.307712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:26:56.308659 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 22 17:26:56.308659 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:26:56.308810 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e2647d15-1f2c-4db4-9d1f-cd2b689d0243 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:26:56.311295 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e2647d15-1f2c-4db4-9d1f-cd2b689d0243 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.095589 Aug 22 17:26:56.315042 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 9/19] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 22 17:26:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:26:56.328965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-543bb19e-2af8-48fa-9bbd-5584da3d5c41 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:56.329597 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-543bb19e-2af8-48fa-9bbd-5584da3d5c41 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:26:56.450880 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Flavor limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:26:56.451614 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Image limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:26:56.451904 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Flavor pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:26:56.452501 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Image pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:26:56.452993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:26:56.476493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:56.477551 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:56.478451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:56.481094 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:56.482322 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:56.486302 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:56.555025 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Getting quotas for project c20e7f3aca4c49ae84390a3f1a8ce410. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:26:56.561712 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Getting quotas for user 864d7f47381e4e4498ad110dbfcfc154 and project c20e7f3aca4c49ae84390a3f1a8ce410. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:26:56.572103 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-543bb19e-2af8-48fa-9bbd-5584da3d5c41 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:56.604311 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-543bb19e-2af8-48fa-9bbd-5584da3d5c41 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1241 microversion: 2.1 time: 0.287275 Aug 22 17:26:56.606686 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 10/20] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:26:56 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1241 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:26:56.612966 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Going to run 1 instances... {{(pid=121852) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:26:56.627838 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1753691282", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:26:56.630320 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:26:56.786706 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.network.neutron [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] validate_networks() for [('4e5a15b8-98bb-4b13-81ee-aec7a6ddff96', None, None, None, None, None)] {{(pid=121853) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:26:56.901103 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-27e32073-617d-4083-b1a1-7ce442e5edc5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.687979 Aug 22 17:26:56.902517 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 11/21] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 22 17:26:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 2711 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 22 17:26:56.928405 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-56813751-118a-4ed9-ba80-a4216b0d5caf tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:56.929417 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-56813751-118a-4ed9-ba80-a4216b0d5caf tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:26:57.090078 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-56813751-118a-4ed9-ba80-a4216b0d5caf tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:57.098052 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-56813751-118a-4ed9-ba80-a4216b0d5caf tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1214 microversion: 2.1 time: 0.194153 Aug 22 17:26:57.098691 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 12/22] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:26:56 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1214 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:26:57.140973 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2c83ecf4-2c86-41df-85b2-551da5bc60a4 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Action: 'create', calling method: .version_select at 0x7f0e5d3afaf0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-621582579", "metadata": {"Type": "work"}}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2c83ecf4-2c86-41df-85b2-551da5bc60a4 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Request method failure captured: Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 119 Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xdfjfrqUxjZlGIlHe2aTwrAamhJ63SPSrK5CbEqCG0JNE0ZLV3HS6VuZMvOWZ2cNzyKkdHz-_CTJFf2G_JXNUf7mYJ3SbJ6p7puOl--cBSP7O4EmND3nOPVnYsxbLPilmiBbQ37kpbiRgwvyQOh8S5jS2eRAhqGbbQ-AoLfqt-BxM Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 0179c56cebe24f9fbe5d907c375f6ab0 Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:26:57.177324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:26:57.180189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0179c56cebe24f9fbe5d907c375f6ab0", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:26:57.180189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:57.180189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 0179c56cebe24f9fbe5d907c375f6ab0 Aug 22 17:26:57.180189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:57.180189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-VolumesNegativeTest-1603114580-project Aug 22 17:26:57.180189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:26:57.180189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:26:57.180189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 00aefa0efeb54dcb9e21dc1b8a9a26d8 Aug 22 17:26:57.180189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-VolumesNegativeTest-1603114580-project Aug 22 17:26:57.180189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Aug 22 17:26:57.180189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-621582579", "metadata": {"Type": "work"}}} Aug 22 17:26:57.180189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: Aug 22 17:26:57.180189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-621582579', 'metadata': {'Type': 'work'}}}} Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi '0' Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:26:57.186853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:26:57.192918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:26:57.202381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 22 17:26:57.202381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.202381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2c83ecf4-2c86-41df-85b2-551da5bc60a4 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:26:57.202381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2c83ecf4-2c86-41df-85b2-551da5bc60a4 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.081473 Aug 22 17:26:57.211003 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 13/23] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 22 17:26:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:26:57.221399 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c1228ef7-07ad-4890-985b-f02c0f3712bf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:57.229868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c1228ef7-07ad-4890-985b-f02c0f3712bf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:26:57.467945 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c1228ef7-07ad-4890-985b-f02c0f3712bf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:57.470167 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c1228ef7-07ad-4890-985b-f02c0f3712bf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:57.473363 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c1228ef7-07ad-4890-985b-f02c0f3712bf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:57.477422 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c1228ef7-07ad-4890-985b-f02c0f3712bf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1280 microversion: 2.20 time: 0.264120 Aug 22 17:26:57.479364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 14/24] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:26:57 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1280 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:26:57.507469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-446381a6-3b99-4fca-9be9-9bca138c782e tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Action: 'create', calling method: .version_select at 0x7f0e5d3a2ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-707930078", "metadata": {"Type": "work"}}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-446381a6-3b99-4fca-9be9-9bca138c782e tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Request method failure captured: Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 118 Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xdfjfrqUxjZlGIlHe2aTwrAamhJ63SPSrK5CbEqCG0JNE0ZLV3HS6VuZMvOWZ2cNzyKkdHz-_CTJFf2G_JXNUf7mYJ3SbJ6p7puOl--cBSP7O4EmND3nOPVnYsxbLPilmiBbQ37kpbiRgwvyQOh8S5jS2eRAhqGbbQ-AoLfqt-BxM Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 0179c56cebe24f9fbe5d907c375f6ab0 Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:26:57.513739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:26:57.516493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0179c56cebe24f9fbe5d907c375f6ab0", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:26:57.516493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:57.516493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 0179c56cebe24f9fbe5d907c375f6ab0 Aug 22 17:26:57.516493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:57.516493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-VolumesNegativeTest-1603114580-project Aug 22 17:26:57.516493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:26:57.516493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:26:57.516493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 00aefa0efeb54dcb9e21dc1b8a9a26d8 Aug 22 17:26:57.516493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-VolumesNegativeTest-1603114580-project Aug 22 17:26:57.516493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Aug 22 17:26:57.516493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-707930078", "metadata": {"Type": "work"}}} Aug 22 17:26:57.516493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: Aug 22 17:26:57.516493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-707930078', 'metadata': {'Type': 'work'}}}} Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise error Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi '' Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:26:57.518077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 22 17:26:57.520672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 22 17:26:57.524456 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 22 17:26:57.524456 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.526546 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-446381a6-3b99-4fca-9be9-9bca138c782e tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:26:57.528641 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-446381a6-3b99-4fca-9be9-9bca138c782e tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.035670 Aug 22 17:26:57.537480 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 15/25] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 22 17:26:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:26:57.549157 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6f739fd4-8c57-4a49-9945-0dea7ea94514 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Calling method '.version_select at 0x7f0e5d3835e0>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:57.615805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-6f739fd4-8c57-4a49-9945-0dea7ea94514 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] HTTP exception thrown: Volume tempest-invalid-1569673594 could not be found. Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6f739fd4-8c57-4a49-9945-0dea7ea94514 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Request method failure captured: Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1569673594 HTTP/1.1 Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xdfjfrqUxjZlGIlHe2aTwrAamhJ63SPSrK5CbEqCG0JNE0ZLV3HS6VuZMvOWZ2cNzyKkdHz-_CTJFf2G_JXNUf7mYJ3SbJ6p7puOl--cBSP7O4EmND3nOPVnYsxbLPilmiBbQ37kpbiRgwvyQOh8S5jS2eRAhqGbbQ-AoLfqt-BxM Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 0179c56cebe24f9fbe5d907c375f6ab0 Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:26:57.625361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:26:57.627485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0179c56cebe24f9fbe5d907c375f6ab0", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:26:57.627485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:57.627485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 0179c56cebe24f9fbe5d907c375f6ab0 Aug 22 17:26:57.627485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:57.627485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-VolumesNegativeTest-1603114580-project Aug 22 17:26:57.627485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:26:57.627485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:26:57.627485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 00aefa0efeb54dcb9e21dc1b8a9a26d8 Aug 22 17:26:57.627485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-VolumesNegativeTest-1603114580-project Aug 22 17:26:57.627485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: Aug 22 17:26:57.627485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Volume tempest-invalid-1569673594 could not be found. Aug 22 17:26:57.627485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': 'tempest-invalid-1569673594'} Aug 22 17:26:57.627485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1569673594 could not be found. (HTTP 404) (Request-ID: req-66c5db2c-6c15-4702-b12f-6ed162ef2669) Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:57.628625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 17:26:57.630408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1569673594 could not be found. Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:26:57.632758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1569673594 could not be found. Aug 22 17:26:57.645318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.645318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:57.645318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.645318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:57.645318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:57.645318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:57.645318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:26:57.645318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:26:57.645318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1569673594 could not be found. Aug 22 17:26:57.645318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:57.648807 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6f739fd4-8c57-4a49-9945-0dea7ea94514 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Returning 404 to user: Volume tempest-invalid-1569673594 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:26:57.651136 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6f739fd4-8c57-4a49-9945-0dea7ea94514 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1569673594" status: 404 len: 99 microversion: 2.1 time: 0.111486 Aug 22 17:26:57.652110 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 16/26] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 22 17:26:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1569673594 => generated 99 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:26:57.678331 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-098b4cba-2049-44f0-9174-8a06d625fc75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:57.681039 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-098b4cba-2049-44f0-9174-8a06d625fc75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:26:57.691444 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-098b4cba-2049-44f0-9174-8a06d625fc75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:57.692319 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-098b4cba-2049-44f0-9174-8a06d625fc75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:57.692956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-098b4cba-2049-44f0-9174-8a06d625fc75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:57.693886 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-098b4cba-2049-44f0-9174-8a06d625fc75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:57.694220 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-098b4cba-2049-44f0-9174-8a06d625fc75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:57.694679 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-098b4cba-2049-44f0-9174-8a06d625fc75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:58.116377 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-098b4cba-2049-44f0-9174-8a06d625fc75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:58.116377 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-098b4cba-2049-44f0-9174-8a06d625fc75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1245 microversion: 2.1 time: 0.342960 Aug 22 17:26:58.116377 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 17/27] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:26:57 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1245 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:26:58.117787 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Flavor limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:26:58.117787 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Image limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:26:58.119187 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0cedc589-1984-4579-a6bc-8b6db7a600f2 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010699 Aug 22 17:26:58.119808 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Flavor pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:26:58.119808 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Image pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:26:58.120198 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 18/28] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Aug 22 17:26:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 17:26:58.120315 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:26:58.120315 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:58.120315 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:58.120315 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:58.120671 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:58.120671 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:58.120671 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:58.120909 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ca50f17d-5f6c-4176-b52a-7ef000d8a135 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.010167 Aug 22 17:26:58.120909 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 19/29] 10.222.0.20 () {58 vars in 1137 bytes} [Mon Aug 22 17:26:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 22 17:26:58.121063 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Getting quotas for project de12c2563d50474cac799d50041a2fa0. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:26:58.121063 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Getting quotas for user f46cbc7de18c4f9fb6f54e96be53fea0 and project de12c2563d50474cac799d50041a2fa0. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:26:58.134097 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-27e0838a-89cc-4205-b4d0-f7ce5e150d48 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Calling method '.version_select at 0x7f0e5d2c2c10>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:58.142712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Going to run 1 instances... {{(pid=121853) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:26:58.148690 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:26:58.188528 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-27e0838a-89cc-4205-b4d0-f7ce5e150d48 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] HTTP exception thrown: Volume 92e5ffc3-da8c-4d04-8af7-f09f8ff05c94 could not be found. Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-27e0838a-89cc-4205-b4d0-f7ce5e150d48 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Request method failure captured: Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: DELETE /compute/v2.1/os-volumes/92e5ffc3-da8c-4d04-8af7-f09f8ff05c94 HTTP/1.1 Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xdfjfrqUxjZlGIlHe2aTwrAamhJ63SPSrK5CbEqCG0JNE0ZLV3HS6VuZMvOWZ2cNzyKkdHz-_CTJFf2G_JXNUf7mYJ3SbJ6p7puOl--cBSP7O4EmND3nOPVnYsxbLPilmiBbQ37kpbiRgwvyQOh8S5jS2eRAhqGbbQ-AoLfqt-BxM Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 0179c56cebe24f9fbe5d907c375f6ab0 Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:26:58.190734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:26:58.191929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0179c56cebe24f9fbe5d907c375f6ab0", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:26:58.191929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:58.191929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 0179c56cebe24f9fbe5d907c375f6ab0 Aug 22 17:26:58.191929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:58.191929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-VolumesNegativeTest-1603114580-project Aug 22 17:26:58.191929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:26:58.191929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:26:58.191929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 00aefa0efeb54dcb9e21dc1b8a9a26d8 Aug 22 17:26:58.191929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-VolumesNegativeTest-1603114580-project Aug 22 17:26:58.191929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: Aug 22 17:26:58.191929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Volume 92e5ffc3-da8c-4d04-8af7-f09f8ff05c94 could not be found. Aug 22 17:26:58.191929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '92e5ffc3-da8c-4d04-8af7-f09f8ff05c94'} Aug 22 17:26:58.191929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 92e5ffc3-da8c-4d04-8af7-f09f8ff05c94 could not be found. (HTTP 404) (Request-ID: req-e158a9d8-b884-4914-9d43-19ed13ee3b7d) Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:58.192635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 17:26:58.194289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 92e5ffc3-da8c-4d04-8af7-f09f8ff05c94 could not be found. Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 17:26:58.195313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:26:58.197960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 92e5ffc3-da8c-4d04-8af7-f09f8ff05c94 could not be found. Aug 22 17:26:58.197960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:58.197960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:58.197960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:58.197960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:58.197960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:58.197960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:58.197960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:26:58.197960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:26:58.197960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 92e5ffc3-da8c-4d04-8af7-f09f8ff05c94 could not be found. Aug 22 17:26:58.197960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:58.197960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-27e0838a-89cc-4205-b4d0-f7ce5e150d48 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Returning 404 to user: Volume 92e5ffc3-da8c-4d04-8af7-f09f8ff05c94 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:26:58.197960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-27e0838a-89cc-4205-b4d0-f7ce5e150d48 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/92e5ffc3-da8c-4d04-8af7-f09f8ff05c94" status: 404 len: 109 microversion: 2.1 time: 0.063725 Aug 22 17:26:58.197960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 20/30] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 22 17:26:58 2022] DELETE /compute/v2.1/os-volumes/92e5ffc3-da8c-4d04-8af7-f09f8ff05c94 => generated 109 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:26:58.199647 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-76d165b0-673a-4e1a-a14b-3619b83467da tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:58.205610 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-76d165b0-673a-4e1a-a14b-3619b83467da tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:26:58.220152 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-76d165b0-673a-4e1a-a14b-3619b83467da tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:58.220659 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-76d165b0-673a-4e1a-a14b-3619b83467da tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:58.221105 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-76d165b0-673a-4e1a-a14b-3619b83467da tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:58.221841 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-76d165b0-673a-4e1a-a14b-3619b83467da tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:58.225293 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-76d165b0-673a-4e1a-a14b-3619b83467da tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:58.233326 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-76d165b0-673a-4e1a-a14b-3619b83467da tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:58.310048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=10 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:58.366913 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-76d165b0-673a-4e1a-a14b-3619b83467da tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:58.377916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-76d165b0-673a-4e1a-a14b-3619b83467da tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1218 microversion: 2.1 time: 0.182193 Aug 22 17:26:58.378873 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 21/31] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:26:58 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1218 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:26:58.385675 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0eb1672a-1fe0-447d-b683-8e890d4390e8 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Calling method '.version_select at 0x7f0e5d2c25e0>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:58.457579 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-0eb1672a-1fe0-447d-b683-8e890d4390e8 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] HTTP exception thrown: Volume bdf24efe-ef18-4168-83c9-c47684bdbfc5 could not be found. Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0eb1672a-1fe0-447d-b683-8e890d4390e8 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Request method failure captured: Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/os-volumes/bdf24efe-ef18-4168-83c9-c47684bdbfc5 HTTP/1.1 Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xdfjfrqUxjZlGIlHe2aTwrAamhJ63SPSrK5CbEqCG0JNE0ZLV3HS6VuZMvOWZ2cNzyKkdHz-_CTJFf2G_JXNUf7mYJ3SbJ6p7puOl--cBSP7O4EmND3nOPVnYsxbLPilmiBbQ37kpbiRgwvyQOh8S5jS2eRAhqGbbQ-AoLfqt-BxM Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 0179c56cebe24f9fbe5d907c375f6ab0 Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:26:58.460007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:26:58.462161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/0179c56cebe24f9fbe5d907c375f6ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_0179c56cebe24f9fbe5d907c375f6ab0", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:26:58.462161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:58.462161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 0179c56cebe24f9fbe5d907c375f6ab0 Aug 22 17:26:58.462161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-VolumesNegativeTest-1603114580 Aug 22 17:26:58.462161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-VolumesNegativeTest-1603114580-project Aug 22 17:26:58.462161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:26:58.462161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:26:58.462161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 00aefa0efeb54dcb9e21dc1b8a9a26d8 Aug 22 17:26:58.462161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-VolumesNegativeTest-1603114580-project Aug 22 17:26:58.462161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: Aug 22 17:26:58.462161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Volume bdf24efe-ef18-4168-83c9-c47684bdbfc5 could not be found. Aug 22 17:26:58.462161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': 'bdf24efe-ef18-4168-83c9-c47684bdbfc5'} Aug 22 17:26:58.462161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bdf24efe-ef18-4168-83c9-c47684bdbfc5 could not be found. (HTTP 404) (Request-ID: req-2836c7af-6591-4319-b506-8270b167d07e) Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:58.463499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:26:58.465387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bdf24efe-ef18-4168-83c9-c47684bdbfc5 could not be found. Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 17:26:58.472115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:26:58.477524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bdf24efe-ef18-4168-83c9-c47684bdbfc5 could not be found. Aug 22 17:26:58.477524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:58.477524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:26:58.477524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:58.477524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:26:58.477524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:26:58.477524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:26:58.477524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:26:58.477524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:26:58.477524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bdf24efe-ef18-4168-83c9-c47684bdbfc5 could not be found. Aug 22 17:26:58.477524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:26:58.477524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0eb1672a-1fe0-447d-b683-8e890d4390e8 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] Returning 404 to user: Volume bdf24efe-ef18-4168-83c9-c47684bdbfc5 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:26:58.477524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0eb1672a-1fe0-447d-b683-8e890d4390e8 tempest-VolumesNegativeTest-1603114580 tempest-VolumesNegativeTest-1603114580-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/bdf24efe-ef18-4168-83c9-c47684bdbfc5" status: 404 len: 109 microversion: 2.1 time: 0.080137 Aug 22 17:26:58.477524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 22/32] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 22 17:26:58 2022] GET /compute/v2.1/os-volumes/bdf24efe-ef18-4168-83c9-c47684bdbfc5 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:26:58.528800 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1f6448a0-26e2-4bc1-87a8-c44c178887d6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.919253 Aug 22 17:26:58.530056 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 11/33] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:26:56 2022] POST /compute/v2.1/servers => generated 383 bytes in 1923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:26:58.533409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b7cbee3c-f4a1-4050-a934-8fbb197a7749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:58.534043 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b7cbee3c-f4a1-4050-a934-8fbb197a7749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:26:58.564744 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8df35a2d-6eae-48c5-b931-917200cf2ec9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:58.564744 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8df35a2d-6eae-48c5-b931-917200cf2ec9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:26:58.742638 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b7cbee3c-f4a1-4050-a934-8fbb197a7749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:58.768081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8df35a2d-6eae-48c5-b931-917200cf2ec9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:58.768960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b7cbee3c-f4a1-4050-a934-8fbb197a7749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:58.774891 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b7cbee3c-f4a1-4050-a934-8fbb197a7749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:58.780964 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b7cbee3c-f4a1-4050-a934-8fbb197a7749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1280 microversion: 2.20 time: 0.253905 Aug 22 17:26:58.783641 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 23/34] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:26:58 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1280 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:26:58.796212 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=29 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:26:58.801095 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8df35a2d-6eae-48c5-b931-917200cf2ec9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1222 microversion: 2.1 time: 0.255280 Aug 22 17:26:58.805504 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 12/35] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:26:58 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1222 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:26:59.084878 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6c4a723e-9718-4bb9-86ac-8e7b1b329192 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:59.087839 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6c4a723e-9718-4bb9-86ac-8e7b1b329192 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:26:59.103492 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c4a723e-9718-4bb9-86ac-8e7b1b329192 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:59.104848 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c4a723e-9718-4bb9-86ac-8e7b1b329192 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:59.105912 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c4a723e-9718-4bb9-86ac-8e7b1b329192 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:59.107515 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c4a723e-9718-4bb9-86ac-8e7b1b329192 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:59.108649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c4a723e-9718-4bb9-86ac-8e7b1b329192 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:59.109682 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c4a723e-9718-4bb9-86ac-8e7b1b329192 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:59.234447 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6c4a723e-9718-4bb9-86ac-8e7b1b329192 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:59.243344 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6c4a723e-9718-4bb9-86ac-8e7b1b329192 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1245 microversion: 2.1 time: 0.165893 Aug 22 17:26:59.243931 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 24/36] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:26:59 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1245 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:26:59.422947 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-993d38b0-6af3-426d-b79d-2c14fd20bd30 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:59.423690 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-993d38b0-6af3-426d-b79d-2c14fd20bd30 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:26:59.446521 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-993d38b0-6af3-426d-b79d-2c14fd20bd30 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:59.447286 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-993d38b0-6af3-426d-b79d-2c14fd20bd30 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:59.448184 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-993d38b0-6af3-426d-b79d-2c14fd20bd30 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:59.449160 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-993d38b0-6af3-426d-b79d-2c14fd20bd30 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:59.449959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-993d38b0-6af3-426d-b79d-2c14fd20bd30 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:59.451280 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-993d38b0-6af3-426d-b79d-2c14fd20bd30 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:59.722337 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-993d38b0-6af3-426d-b79d-2c14fd20bd30 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:26:59.747606 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-993d38b0-6af3-426d-b79d-2c14fd20bd30 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1218 microversion: 2.1 time: 0.330649 Aug 22 17:26:59.749785 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 13/37] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:26:59 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1218 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:26:59.838340 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-9d66ee22-451d-454f-b063-e2490716cff4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:59.839515 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f894e066-99c8-4734-832e-77e63dfccdeb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:26:59.840841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9d66ee22-451d-454f-b063-e2490716cff4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:26:59.841155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f894e066-99c8-4734-832e-77e63dfccdeb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:26:59.880325 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f894e066-99c8-4734-832e-77e63dfccdeb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:59.884639 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f894e066-99c8-4734-832e-77e63dfccdeb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:59.885115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f894e066-99c8-4734-832e-77e63dfccdeb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:26:59.888626 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f894e066-99c8-4734-832e-77e63dfccdeb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:26:59.892552 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f894e066-99c8-4734-832e-77e63dfccdeb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:26:59.894334 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f894e066-99c8-4734-832e-77e63dfccdeb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:00.031829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f894e066-99c8-4734-832e-77e63dfccdeb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:00.035528 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-9d66ee22-451d-454f-b063-e2490716cff4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:00.048441 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f894e066-99c8-4734-832e-77e63dfccdeb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:00.049181 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-9d66ee22-451d-454f-b063-e2490716cff4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1222 microversion: 2.1 time: 0.220017 Aug 22 17:27:00.049795 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 14/38] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:26:59 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1222 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:00.055446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f894e066-99c8-4734-832e-77e63dfccdeb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:00.058644 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f894e066-99c8-4734-832e-77e63dfccdeb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1284 microversion: 2.20 time: 0.232278 Aug 22 17:27:00.060231 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 25/39] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:26:59 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1284 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:00.275493 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-df355f38-5713-45ba-8266-7fe541191504 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:00.278334 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-df355f38-5713-45ba-8266-7fe541191504 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:00.298096 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-df355f38-5713-45ba-8266-7fe541191504 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:00.299850 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-df355f38-5713-45ba-8266-7fe541191504 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:00.301038 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-df355f38-5713-45ba-8266-7fe541191504 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:00.305534 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-df355f38-5713-45ba-8266-7fe541191504 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:00.306416 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-df355f38-5713-45ba-8266-7fe541191504 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:00.307052 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-df355f38-5713-45ba-8266-7fe541191504 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:00.411321 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-df355f38-5713-45ba-8266-7fe541191504 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:00.421446 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-df355f38-5713-45ba-8266-7fe541191504 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1245 microversion: 2.1 time: 0.151185 Aug 22 17:27:00.422072 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 15/40] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:00 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1245 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:00.780114 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d6211d73-a157-4651-bb45-396a8bdc3b70 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:00.780757 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d6211d73-a157-4651-bb45-396a8bdc3b70 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:00.796081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d6211d73-a157-4651-bb45-396a8bdc3b70 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:00.796615 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d6211d73-a157-4651-bb45-396a8bdc3b70 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:00.797084 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d6211d73-a157-4651-bb45-396a8bdc3b70 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:00.797794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d6211d73-a157-4651-bb45-396a8bdc3b70 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:00.798272 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d6211d73-a157-4651-bb45-396a8bdc3b70 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:00.798750 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d6211d73-a157-4651-bb45-396a8bdc3b70 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:00.997872 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-d6211d73-a157-4651-bb45-396a8bdc3b70 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:01.048904 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d6211d73-a157-4651-bb45-396a8bdc3b70 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1218 microversion: 2.1 time: 0.277008 Aug 22 17:27:01.051264 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 26/41] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:00 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1218 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:01.073037 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1b0c04f6-a578-424b-8d56-172fe4cbf87f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:01.073849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1b0c04f6-a578-424b-8d56-172fe4cbf87f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:01.092943 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b0c04f6-a578-424b-8d56-172fe4cbf87f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:01.092943 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b0c04f6-a578-424b-8d56-172fe4cbf87f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:01.092943 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b0c04f6-a578-424b-8d56-172fe4cbf87f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:01.092943 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b0c04f6-a578-424b-8d56-172fe4cbf87f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:01.098195 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ec63ec28-abf1-413e-9498-b072f59f3753 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:01.099100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ec63ec28-abf1-413e-9498-b072f59f3753 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:01.103478 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b0c04f6-a578-424b-8d56-172fe4cbf87f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:01.103906 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b0c04f6-a578-424b-8d56-172fe4cbf87f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:01.117224 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ec63ec28-abf1-413e-9498-b072f59f3753 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:01.117736 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ec63ec28-abf1-413e-9498-b072f59f3753 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:01.118180 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ec63ec28-abf1-413e-9498-b072f59f3753 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:01.123708 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ec63ec28-abf1-413e-9498-b072f59f3753 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:01.123708 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ec63ec28-abf1-413e-9498-b072f59f3753 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:01.123708 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ec63ec28-abf1-413e-9498-b072f59f3753 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:01.327857 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ec63ec28-abf1-413e-9498-b072f59f3753 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:01.339089 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ec63ec28-abf1-413e-9498-b072f59f3753 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:01.340768 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ec63ec28-abf1-413e-9498-b072f59f3753 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:01.341991 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ec63ec28-abf1-413e-9498-b072f59f3753 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1284 microversion: 2.20 time: 0.247758 Aug 22 17:27:01.352933 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 27/42] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:01 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1284 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:01.390359 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1b0c04f6-a578-424b-8d56-172fe4cbf87f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:01.427162 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1b0c04f6-a578-424b-8d56-172fe4cbf87f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1226 microversion: 2.1 time: 0.358522 Aug 22 17:27:01.455935 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 16/43] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:01 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1226 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:01.463704 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e1886a1a-6fe8-4c15-b3d7-5ee34f968ac7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:01.463704 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e1886a1a-6fe8-4c15-b3d7-5ee34f968ac7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:01.481750 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e1886a1a-6fe8-4c15-b3d7-5ee34f968ac7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:01.484396 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e1886a1a-6fe8-4c15-b3d7-5ee34f968ac7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:01.487435 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e1886a1a-6fe8-4c15-b3d7-5ee34f968ac7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:01.487735 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e1886a1a-6fe8-4c15-b3d7-5ee34f968ac7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:01.488438 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e1886a1a-6fe8-4c15-b3d7-5ee34f968ac7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:01.489651 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e1886a1a-6fe8-4c15-b3d7-5ee34f968ac7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:01.754772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e1886a1a-6fe8-4c15-b3d7-5ee34f968ac7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:01.768302 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e1886a1a-6fe8-4c15-b3d7-5ee34f968ac7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1245 microversion: 2.1 time: 0.312101 Aug 22 17:27:01.768910 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 28/44] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:01 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1245 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:02.101563 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4152ec80-8c93-4075-80a1-415fc3280104 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:02.103431 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4152ec80-8c93-4075-80a1-415fc3280104 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:02.125519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4152ec80-8c93-4075-80a1-415fc3280104 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:02.135209 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4152ec80-8c93-4075-80a1-415fc3280104 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:02.136114 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4152ec80-8c93-4075-80a1-415fc3280104 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:02.137127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4152ec80-8c93-4075-80a1-415fc3280104 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:02.138370 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4152ec80-8c93-4075-80a1-415fc3280104 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:02.140294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4152ec80-8c93-4075-80a1-415fc3280104 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:02.309643 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4152ec80-8c93-4075-80a1-415fc3280104 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:02.324191 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4152ec80-8c93-4075-80a1-415fc3280104 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1266 microversion: 2.1 time: 0.236507 Aug 22 17:27:02.338766 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 17/45] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:02 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:02.384353 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-58c6a780-7763-4bfe-97cc-33ff7c24dbc0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:02.384353 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-58c6a780-7763-4bfe-97cc-33ff7c24dbc0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:02.394828 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-58c6a780-7763-4bfe-97cc-33ff7c24dbc0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:02.398875 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-58c6a780-7763-4bfe-97cc-33ff7c24dbc0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:02.400510 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-58c6a780-7763-4bfe-97cc-33ff7c24dbc0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:02.401376 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-58c6a780-7763-4bfe-97cc-33ff7c24dbc0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:02.402591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-58c6a780-7763-4bfe-97cc-33ff7c24dbc0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:02.403145 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-58c6a780-7763-4bfe-97cc-33ff7c24dbc0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:02.479837 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cdb57c05-a094-4237-a501-ea5861eec56d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:02.494082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-cdb57c05-a094-4237-a501-ea5861eec56d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:02.495198 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-58c6a780-7763-4bfe-97cc-33ff7c24dbc0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:02.499129 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cdb57c05-a094-4237-a501-ea5861eec56d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:02.499822 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cdb57c05-a094-4237-a501-ea5861eec56d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:02.500428 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cdb57c05-a094-4237-a501-ea5861eec56d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:02.501305 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cdb57c05-a094-4237-a501-ea5861eec56d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:02.501891 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cdb57c05-a094-4237-a501-ea5861eec56d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:02.503746 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cdb57c05-a094-4237-a501-ea5861eec56d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:02.515742 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-58c6a780-7763-4bfe-97cc-33ff7c24dbc0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:02.522293 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-58c6a780-7763-4bfe-97cc-33ff7c24dbc0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:02.528648 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-58c6a780-7763-4bfe-97cc-33ff7c24dbc0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1332 microversion: 2.20 time: 0.156842 Aug 22 17:27:02.530033 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 29/46] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:02 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1332 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:02.617204 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-cdb57c05-a094-4237-a501-ea5861eec56d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:02.630883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-cdb57c05-a094-4237-a501-ea5861eec56d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1274 microversion: 2.1 time: 0.155463 Aug 22 17:27:02.632168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 18/47] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:02 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1274 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:02.798218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-83b0f1fb-f7dd-47d7-bc4f-0bb27996e3ef tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:02.799685 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-83b0f1fb-f7dd-47d7-bc4f-0bb27996e3ef tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:02.809685 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83b0f1fb-f7dd-47d7-bc4f-0bb27996e3ef tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:02.810995 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83b0f1fb-f7dd-47d7-bc4f-0bb27996e3ef tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:02.812030 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83b0f1fb-f7dd-47d7-bc4f-0bb27996e3ef tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:02.813629 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83b0f1fb-f7dd-47d7-bc4f-0bb27996e3ef tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:02.814354 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83b0f1fb-f7dd-47d7-bc4f-0bb27996e3ef tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:02.815146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83b0f1fb-f7dd-47d7-bc4f-0bb27996e3ef tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:02.917886 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-83b0f1fb-f7dd-47d7-bc4f-0bb27996e3ef tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:02.931018 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-83b0f1fb-f7dd-47d7-bc4f-0bb27996e3ef tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1293 microversion: 2.1 time: 0.137094 Aug 22 17:27:02.946405 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 30/48] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:02 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1293 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:03.353715 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-728a5f32-7e0a-429d-a7e6-7a3494bcf992 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:03.354565 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-728a5f32-7e0a-429d-a7e6-7a3494bcf992 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:03.364685 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-728a5f32-7e0a-429d-a7e6-7a3494bcf992 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:03.366507 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-728a5f32-7e0a-429d-a7e6-7a3494bcf992 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:03.367472 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-728a5f32-7e0a-429d-a7e6-7a3494bcf992 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:03.368620 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-728a5f32-7e0a-429d-a7e6-7a3494bcf992 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:03.377988 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-728a5f32-7e0a-429d-a7e6-7a3494bcf992 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:03.379923 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-728a5f32-7e0a-429d-a7e6-7a3494bcf992 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:03.467220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-728a5f32-7e0a-429d-a7e6-7a3494bcf992 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:03.485776 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-728a5f32-7e0a-429d-a7e6-7a3494bcf992 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1274 microversion: 2.1 time: 0.136653 Aug 22 17:27:03.487345 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 19/49] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:03 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1274 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:03.554360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-87d324d1-2a1d-44d3-8dcc-b7ee267516d5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:03.555017 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-87d324d1-2a1d-44d3-8dcc-b7ee267516d5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:03.591660 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87d324d1-2a1d-44d3-8dcc-b7ee267516d5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:03.592545 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87d324d1-2a1d-44d3-8dcc-b7ee267516d5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:03.593412 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87d324d1-2a1d-44d3-8dcc-b7ee267516d5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:03.594353 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87d324d1-2a1d-44d3-8dcc-b7ee267516d5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:03.596966 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87d324d1-2a1d-44d3-8dcc-b7ee267516d5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:03.597667 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87d324d1-2a1d-44d3-8dcc-b7ee267516d5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:03.654368 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6aa00b87-f61a-4b27-bc76-122e9bcd66cd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:03.655285 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6aa00b87-f61a-4b27-bc76-122e9bcd66cd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:03.681299 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6aa00b87-f61a-4b27-bc76-122e9bcd66cd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:03.681299 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6aa00b87-f61a-4b27-bc76-122e9bcd66cd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:03.683302 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6aa00b87-f61a-4b27-bc76-122e9bcd66cd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:03.687331 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6aa00b87-f61a-4b27-bc76-122e9bcd66cd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:03.699099 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6aa00b87-f61a-4b27-bc76-122e9bcd66cd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:03.699752 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6aa00b87-f61a-4b27-bc76-122e9bcd66cd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:03.878025 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-87d324d1-2a1d-44d3-8dcc-b7ee267516d5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:03.910678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-87d324d1-2a1d-44d3-8dcc-b7ee267516d5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:03.920161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-87d324d1-2a1d-44d3-8dcc-b7ee267516d5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:03.929271 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-87d324d1-2a1d-44d3-8dcc-b7ee267516d5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1340 microversion: 2.20 time: 0.375193 Aug 22 17:27:03.943465 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 31/50] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:03 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1340 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:03.956697 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-454ac220-648c-4288-9bc9-23f08eac43ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:03.960776 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-454ac220-648c-4288-9bc9-23f08eac43ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:03.982056 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-454ac220-648c-4288-9bc9-23f08eac43ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:03.982903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-454ac220-648c-4288-9bc9-23f08eac43ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:03.983516 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-454ac220-648c-4288-9bc9-23f08eac43ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:03.984277 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-454ac220-648c-4288-9bc9-23f08eac43ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:03.984909 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-454ac220-648c-4288-9bc9-23f08eac43ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:03.985334 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-454ac220-648c-4288-9bc9-23f08eac43ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:04.202859 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-454ac220-648c-4288-9bc9-23f08eac43ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:04.207046 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6aa00b87-f61a-4b27-bc76-122e9bcd66cd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:04.216898 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6aa00b87-f61a-4b27-bc76-122e9bcd66cd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1274 microversion: 2.1 time: 0.566301 Aug 22 17:27:04.217834 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 20/51] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:03 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1274 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:04.224998 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-454ac220-648c-4288-9bc9-23f08eac43ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1293 microversion: 2.1 time: 0.273563 Aug 22 17:27:04.239396 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 32/52] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:03 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1293 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:04.532291 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-82b180eb-e193-4729-986c-4d679976164d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:04.534548 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-82b180eb-e193-4729-986c-4d679976164d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:04.567208 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-82b180eb-e193-4729-986c-4d679976164d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:04.568909 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-82b180eb-e193-4729-986c-4d679976164d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:04.569853 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-82b180eb-e193-4729-986c-4d679976164d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:04.598820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-82b180eb-e193-4729-986c-4d679976164d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:04.600043 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-82b180eb-e193-4729-986c-4d679976164d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:04.607181 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-82b180eb-e193-4729-986c-4d679976164d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:04.747575 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-82b180eb-e193-4729-986c-4d679976164d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:04.771236 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-82b180eb-e193-4729-986c-4d679976164d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1272 microversion: 2.1 time: 0.246675 Aug 22 17:27:04.771236 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 21/53] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:04 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1272 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:04.982961 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-82df3a9f-e208-45d8-b41c-6525dd660095 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:04.984355 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-82df3a9f-e208-45d8-b41c-6525dd660095 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:04.996284 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-82df3a9f-e208-45d8-b41c-6525dd660095 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:04.996284 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-82df3a9f-e208-45d8-b41c-6525dd660095 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:04.996284 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-82df3a9f-e208-45d8-b41c-6525dd660095 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:05.006211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-82df3a9f-e208-45d8-b41c-6525dd660095 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:05.006853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-82df3a9f-e208-45d8-b41c-6525dd660095 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:05.007310 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-82df3a9f-e208-45d8-b41c-6525dd660095 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:05.142506 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-82df3a9f-e208-45d8-b41c-6525dd660095 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:05.156957 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-82df3a9f-e208-45d8-b41c-6525dd660095 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:05.164088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-82df3a9f-e208-45d8-b41c-6525dd660095 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:05.180321 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-82df3a9f-e208-45d8-b41c-6525dd660095 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1338 microversion: 2.20 time: 0.193169 Aug 22 17:27:05.180321 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 33/54] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:04 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1338 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:05.241308 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-55f096f6-44f5-4f6d-82aa-ab3bf855cc47 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:05.242268 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-55f096f6-44f5-4f6d-82aa-ab3bf855cc47 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:05.249209 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55f096f6-44f5-4f6d-82aa-ab3bf855cc47 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:05.249782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55f096f6-44f5-4f6d-82aa-ab3bf855cc47 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:05.252765 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55f096f6-44f5-4f6d-82aa-ab3bf855cc47 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:05.252765 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55f096f6-44f5-4f6d-82aa-ab3bf855cc47 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:05.252765 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55f096f6-44f5-4f6d-82aa-ab3bf855cc47 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:05.252765 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55f096f6-44f5-4f6d-82aa-ab3bf855cc47 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:05.272236 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-cd5ffe08-d17c-468d-9e42-738fabf8c3f6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:05.273434 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-cd5ffe08-d17c-468d-9e42-738fabf8c3f6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:05.285560 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cd5ffe08-d17c-468d-9e42-738fabf8c3f6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:05.286513 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cd5ffe08-d17c-468d-9e42-738fabf8c3f6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:05.287779 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cd5ffe08-d17c-468d-9e42-738fabf8c3f6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:05.292969 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cd5ffe08-d17c-468d-9e42-738fabf8c3f6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:05.293820 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cd5ffe08-d17c-468d-9e42-738fabf8c3f6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:05.294600 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cd5ffe08-d17c-468d-9e42-738fabf8c3f6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:05.579330 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-55f096f6-44f5-4f6d-82aa-ab3bf855cc47 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:05.591550 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-55f096f6-44f5-4f6d-82aa-ab3bf855cc47 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1280 microversion: 2.1 time: 0.354908 Aug 22 17:27:05.592519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 22/55] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:05 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1280 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:05.643229 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-cd5ffe08-d17c-468d-9e42-738fabf8c3f6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:05.654282 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-cd5ffe08-d17c-468d-9e42-738fabf8c3f6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1299 microversion: 2.1 time: 0.393035 Aug 22 17:27:05.655345 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 34/56] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:05 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1299 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:05.797845 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d35bed52-e7d0-4dd3-9f72-8790f1f1b9f8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:05.799539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d35bed52-e7d0-4dd3-9f72-8790f1f1b9f8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:05.820016 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d35bed52-e7d0-4dd3-9f72-8790f1f1b9f8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:05.820016 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d35bed52-e7d0-4dd3-9f72-8790f1f1b9f8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:05.820016 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d35bed52-e7d0-4dd3-9f72-8790f1f1b9f8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:05.821588 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d35bed52-e7d0-4dd3-9f72-8790f1f1b9f8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:05.822394 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d35bed52-e7d0-4dd3-9f72-8790f1f1b9f8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:05.823052 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d35bed52-e7d0-4dd3-9f72-8790f1f1b9f8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:05.970421 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d35bed52-e7d0-4dd3-9f72-8790f1f1b9f8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:05.981897 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d35bed52-e7d0-4dd3-9f72-8790f1f1b9f8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1272 microversion: 2.1 time: 0.192122 Aug 22 17:27:05.985936 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 23/57] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:05 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:06.207054 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-992aac19-dd39-412c-aba7-085fe3567976 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:06.211466 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-992aac19-dd39-412c-aba7-085fe3567976 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:06.229591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-992aac19-dd39-412c-aba7-085fe3567976 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:06.260075 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-992aac19-dd39-412c-aba7-085fe3567976 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:06.260723 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-992aac19-dd39-412c-aba7-085fe3567976 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:06.264665 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-992aac19-dd39-412c-aba7-085fe3567976 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:06.265161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-992aac19-dd39-412c-aba7-085fe3567976 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:06.265650 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-992aac19-dd39-412c-aba7-085fe3567976 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:06.470206 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-992aac19-dd39-412c-aba7-085fe3567976 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:06.512038 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-992aac19-dd39-412c-aba7-085fe3567976 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:06.526305 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-992aac19-dd39-412c-aba7-085fe3567976 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:06.532008 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-992aac19-dd39-412c-aba7-085fe3567976 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1338 microversion: 2.20 time: 0.335163 Aug 22 17:27:06.537961 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 35/58] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:06 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1338 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:06.628730 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a027b671-c06e-442d-8741-f75558819dc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:06.629664 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a027b671-c06e-442d-8741-f75558819dc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:06.639124 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a027b671-c06e-442d-8741-f75558819dc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:06.658675 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a027b671-c06e-442d-8741-f75558819dc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:06.659685 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a027b671-c06e-442d-8741-f75558819dc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:06.663260 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a027b671-c06e-442d-8741-f75558819dc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:06.667781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a027b671-c06e-442d-8741-f75558819dc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:06.674600 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a027b671-c06e-442d-8741-f75558819dc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:06.701071 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5b392b89-7c73-4dfc-afbd-17057146055f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:06.728366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5b392b89-7c73-4dfc-afbd-17057146055f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:06.743026 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=4 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:06.752370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5b392b89-7c73-4dfc-afbd-17057146055f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:06.753942 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5b392b89-7c73-4dfc-afbd-17057146055f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:06.755163 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5b392b89-7c73-4dfc-afbd-17057146055f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:06.757387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5b392b89-7c73-4dfc-afbd-17057146055f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:06.771501 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5b392b89-7c73-4dfc-afbd-17057146055f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:06.776202 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5b392b89-7c73-4dfc-afbd-17057146055f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:07.094345 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5b392b89-7c73-4dfc-afbd-17057146055f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:07.103608 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a027b671-c06e-442d-8741-f75558819dc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:07.104768 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5b392b89-7c73-4dfc-afbd-17057146055f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1299 microversion: 2.1 time: 0.412185 Aug 22 17:27:07.105474 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 36/59] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:06 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1299 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:07.125665 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a027b671-c06e-442d-8741-f75558819dc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1280 microversion: 2.1 time: 0.500745 Aug 22 17:27:07.130261 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-217882e7-5cb8-46bd-83e7-d63f37f22fbd tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:07.135377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 24/60] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:06 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1280 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:07.141797 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-217882e7-5cb8-46bd-83e7-d63f37f22fbd tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:07.155469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-217882e7-5cb8-46bd-83e7-d63f37f22fbd tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:07.156471 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-217882e7-5cb8-46bd-83e7-d63f37f22fbd tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:07.157722 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-217882e7-5cb8-46bd-83e7-d63f37f22fbd tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:07.158740 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-217882e7-5cb8-46bd-83e7-d63f37f22fbd tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:07.159536 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-217882e7-5cb8-46bd-83e7-d63f37f22fbd tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:07.161583 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-217882e7-5cb8-46bd-83e7-d63f37f22fbd tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:07.582930 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b208490c-7fa8-4d45-a2fc-25bba5a04a4c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:07.582930 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b208490c-7fa8-4d45-a2fc-25bba5a04a4c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:07.640569 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b208490c-7fa8-4d45-a2fc-25bba5a04a4c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:07.644720 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b208490c-7fa8-4d45-a2fc-25bba5a04a4c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:07.645703 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b208490c-7fa8-4d45-a2fc-25bba5a04a4c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:07.653407 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b208490c-7fa8-4d45-a2fc-25bba5a04a4c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:07.655340 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b208490c-7fa8-4d45-a2fc-25bba5a04a4c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:07.661161 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b208490c-7fa8-4d45-a2fc-25bba5a04a4c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:07.682400 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-217882e7-5cb8-46bd-83e7-d63f37f22fbd tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:07.685959 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=100 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:07.702908 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-217882e7-5cb8-46bd-83e7-d63f37f22fbd tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.583979 Aug 22 17:27:07.717305 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 37/61] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:07 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:07.880139 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b208490c-7fa8-4d45-a2fc-25bba5a04a4c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:07.927918 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b208490c-7fa8-4d45-a2fc-25bba5a04a4c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:07.943877 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b208490c-7fa8-4d45-a2fc-25bba5a04a4c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:07.947223 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b208490c-7fa8-4d45-a2fc-25bba5a04a4c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1338 microversion: 2.20 time: 0.387251 Aug 22 17:27:07.965425 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 25/62] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:07 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1338 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:08.129529 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-580ccf4a-1938-414c-b064-acb96099c7d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:08.130290 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-580ccf4a-1938-414c-b064-acb96099c7d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:08.142855 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-580ccf4a-1938-414c-b064-acb96099c7d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:08.143602 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-580ccf4a-1938-414c-b064-acb96099c7d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:08.144120 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-580ccf4a-1938-414c-b064-acb96099c7d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:08.146156 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-580ccf4a-1938-414c-b064-acb96099c7d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:08.148096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-580ccf4a-1938-414c-b064-acb96099c7d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:08.153633 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-580ccf4a-1938-414c-b064-acb96099c7d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:08.163894 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b6a736ba-4e3e-4f3e-9056-5868831b36e6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:08.166738 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b6a736ba-4e3e-4f3e-9056-5868831b36e6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:08.191279 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=6 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:08.196096 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b6a736ba-4e3e-4f3e-9056-5868831b36e6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:08.197329 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b6a736ba-4e3e-4f3e-9056-5868831b36e6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:08.199448 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b6a736ba-4e3e-4f3e-9056-5868831b36e6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:08.202141 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b6a736ba-4e3e-4f3e-9056-5868831b36e6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:08.203243 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b6a736ba-4e3e-4f3e-9056-5868831b36e6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:08.204228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b6a736ba-4e3e-4f3e-9056-5868831b36e6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:08.491396 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b6a736ba-4e3e-4f3e-9056-5868831b36e6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:08.501092 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b6a736ba-4e3e-4f3e-9056-5868831b36e6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.347412 Aug 22 17:27:08.501854 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 26/63] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:08 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:08.649573 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-580ccf4a-1938-414c-b064-acb96099c7d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:08.661773 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-580ccf4a-1938-414c-b064-acb96099c7d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.536968 Aug 22 17:27:08.663785 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 38/64] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:08 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:08.727630 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-9ac0de00-4d7d-46ad-bf29-c1b724b2b3a9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:08.728592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9ac0de00-4d7d-46ad-bf29-c1b724b2b3a9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:08.738990 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ac0de00-4d7d-46ad-bf29-c1b724b2b3a9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:08.740404 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ac0de00-4d7d-46ad-bf29-c1b724b2b3a9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:08.741410 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ac0de00-4d7d-46ad-bf29-c1b724b2b3a9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:08.742513 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ac0de00-4d7d-46ad-bf29-c1b724b2b3a9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:08.743218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ac0de00-4d7d-46ad-bf29-c1b724b2b3a9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:08.744209 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ac0de00-4d7d-46ad-bf29-c1b724b2b3a9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:08.999310 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-12a18731-6ea0-4d83-b461-25ea64f095b1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:09.004433 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-12a18731-6ea0-4d83-b461-25ea64f095b1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:09.015351 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-9ac0de00-4d7d-46ad-bf29-c1b724b2b3a9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:09.016139 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=22 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:09.038208 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-9ac0de00-4d7d-46ad-bf29-c1b724b2b3a9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.316323 Aug 22 17:27:09.040493 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 27/65] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:08 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:09.047807 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-12a18731-6ea0-4d83-b461-25ea64f095b1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:09.058546 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-12a18731-6ea0-4d83-b461-25ea64f095b1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:09.059504 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-12a18731-6ea0-4d83-b461-25ea64f095b1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:09.061794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-12a18731-6ea0-4d83-b461-25ea64f095b1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:09.064120 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-12a18731-6ea0-4d83-b461-25ea64f095b1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:09.067196 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-12a18731-6ea0-4d83-b461-25ea64f095b1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:09.479593 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-12a18731-6ea0-4d83-b461-25ea64f095b1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:09.513962 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-12a18731-6ea0-4d83-b461-25ea64f095b1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:09.518790 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-12a18731-6ea0-4d83-b461-25ea64f095b1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:09.521777 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-12a18731-6ea0-4d83-b461-25ea64f095b1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.531925 Aug 22 17:27:09.523677 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 39/66] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:08 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:09.545136 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-9e8a5e25-ffaa-4ba9-a0bd-4968553d42da tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:09.546333 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9e8a5e25-ffaa-4ba9-a0bd-4968553d42da tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:09.558436 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9e8a5e25-ffaa-4ba9-a0bd-4968553d42da tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:09.559863 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9e8a5e25-ffaa-4ba9-a0bd-4968553d42da tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:09.560821 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9e8a5e25-ffaa-4ba9-a0bd-4968553d42da tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:09.562312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9e8a5e25-ffaa-4ba9-a0bd-4968553d42da tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:09.563399 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9e8a5e25-ffaa-4ba9-a0bd-4968553d42da tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:09.564369 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9e8a5e25-ffaa-4ba9-a0bd-4968553d42da tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:09.689969 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-afc156d1-18c2-481e-b9ed-dbb8df912f8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:09.698953 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-afc156d1-18c2-481e-b9ed-dbb8df912f8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:09.730256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afc156d1-18c2-481e-b9ed-dbb8df912f8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:09.731153 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afc156d1-18c2-481e-b9ed-dbb8df912f8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:09.735425 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afc156d1-18c2-481e-b9ed-dbb8df912f8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:09.738534 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afc156d1-18c2-481e-b9ed-dbb8df912f8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:09.742654 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afc156d1-18c2-481e-b9ed-dbb8df912f8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:09.745643 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afc156d1-18c2-481e-b9ed-dbb8df912f8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:09.848738 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-9e8a5e25-ffaa-4ba9-a0bd-4968553d42da tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:09.888237 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-9e8a5e25-ffaa-4ba9-a0bd-4968553d42da tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.352775 Aug 22 17:27:09.894153 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 28/67] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:09 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:10.027474 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-afc156d1-18c2-481e-b9ed-dbb8df912f8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:10.036731 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-afc156d1-18c2-481e-b9ed-dbb8df912f8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.354004 Aug 22 17:27:10.038079 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 40/68] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:09 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:10.085857 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4010753d-41e6-4df6-b4ee-dfe8473801e0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:10.086869 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4010753d-41e6-4df6-b4ee-dfe8473801e0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:10.089169 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=3 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:10.095857 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4010753d-41e6-4df6-b4ee-dfe8473801e0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:10.096646 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4010753d-41e6-4df6-b4ee-dfe8473801e0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:10.102976 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4010753d-41e6-4df6-b4ee-dfe8473801e0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:10.109789 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4010753d-41e6-4df6-b4ee-dfe8473801e0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:10.111828 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4010753d-41e6-4df6-b4ee-dfe8473801e0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:10.112606 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4010753d-41e6-4df6-b4ee-dfe8473801e0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:10.174799 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=100 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:10.454603 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4010753d-41e6-4df6-b4ee-dfe8473801e0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:10.467827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4010753d-41e6-4df6-b4ee-dfe8473801e0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.389927 Aug 22 17:27:10.469066 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 29/69] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:10 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:10.566240 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-20fefec9-6d84-4064-903c-f23d3b6b866b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:10.566240 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-20fefec9-6d84-4064-903c-f23d3b6b866b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:10.566240 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-20fefec9-6d84-4064-903c-f23d3b6b866b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:10.566240 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-20fefec9-6d84-4064-903c-f23d3b6b866b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:10.566620 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-20fefec9-6d84-4064-903c-f23d3b6b866b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:10.566620 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-20fefec9-6d84-4064-903c-f23d3b6b866b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:10.566620 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-20fefec9-6d84-4064-903c-f23d3b6b866b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:10.566620 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-20fefec9-6d84-4064-903c-f23d3b6b866b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:10.919664 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8108a104-7174-4e43-9ec0-e8194bc17434 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:10.920956 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8108a104-7174-4e43-9ec0-e8194bc17434 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:10.936952 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8108a104-7174-4e43-9ec0-e8194bc17434 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:10.937727 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8108a104-7174-4e43-9ec0-e8194bc17434 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:10.941304 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8108a104-7174-4e43-9ec0-e8194bc17434 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:10.942139 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8108a104-7174-4e43-9ec0-e8194bc17434 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:10.942609 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8108a104-7174-4e43-9ec0-e8194bc17434 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:10.943766 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8108a104-7174-4e43-9ec0-e8194bc17434 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:11.180255 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8108a104-7174-4e43-9ec0-e8194bc17434 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:11.197911 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8108a104-7174-4e43-9ec0-e8194bc17434 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.282948 Aug 22 17:27:11.199970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 30/70] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:10 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:11.205369 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8a02578d-e877-419b-8e66-48d0f1d18d4c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:11.207109 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8a02578d-e877-419b-8e66-48d0f1d18d4c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:11.216034 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8a02578d-e877-419b-8e66-48d0f1d18d4c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:11.217615 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8a02578d-e877-419b-8e66-48d0f1d18d4c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:11.218243 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8a02578d-e877-419b-8e66-48d0f1d18d4c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:11.219972 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8a02578d-e877-419b-8e66-48d0f1d18d4c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:11.221961 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8a02578d-e877-419b-8e66-48d0f1d18d4c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:11.225994 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8a02578d-e877-419b-8e66-48d0f1d18d4c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:11.266335 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-20fefec9-6d84-4064-903c-f23d3b6b866b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:11.279658 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-20fefec9-6d84-4064-903c-f23d3b6b866b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:11.284515 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-20fefec9-6d84-4064-903c-f23d3b6b866b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:11.291195 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-20fefec9-6d84-4064-903c-f23d3b6b866b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.742072 Aug 22 17:27:11.295320 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 41/71] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:10 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:27:11.526793 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3424ee3a-9b74-45c1-aa2a-cc2bacb70e39 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:11.528255 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3424ee3a-9b74-45c1-aa2a-cc2bacb70e39 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:11.564097 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3424ee3a-9b74-45c1-aa2a-cc2bacb70e39 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:11.565735 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3424ee3a-9b74-45c1-aa2a-cc2bacb70e39 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:11.566899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3424ee3a-9b74-45c1-aa2a-cc2bacb70e39 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:11.569509 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3424ee3a-9b74-45c1-aa2a-cc2bacb70e39 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:11.570726 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3424ee3a-9b74-45c1-aa2a-cc2bacb70e39 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:11.576984 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3424ee3a-9b74-45c1-aa2a-cc2bacb70e39 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:11.838522 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8a02578d-e877-419b-8e66-48d0f1d18d4c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:11.895728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8a02578d-e877-419b-8e66-48d0f1d18d4c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.693848 Aug 22 17:27:11.899595 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 31/72] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:11 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:12.242562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2d617ba4-2caa-430f-8262-ccecec714526 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:12.244003 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2d617ba4-2caa-430f-8262-ccecec714526 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:12.271048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d617ba4-2caa-430f-8262-ccecec714526 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:12.273813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d617ba4-2caa-430f-8262-ccecec714526 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:12.279571 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d617ba4-2caa-430f-8262-ccecec714526 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:12.280780 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d617ba4-2caa-430f-8262-ccecec714526 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:12.289586 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d617ba4-2caa-430f-8262-ccecec714526 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:12.293501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d617ba4-2caa-430f-8262-ccecec714526 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:12.649376 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3424ee3a-9b74-45c1-aa2a-cc2bacb70e39 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:12.670065 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3424ee3a-9b74-45c1-aa2a-cc2bacb70e39 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 1.149061 Aug 22 17:27:12.670065 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 42/73] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:11 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:12.687738 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6640f18c-acea-4335-a830-1b31a7b51fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:12.692721 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6640f18c-acea-4335-a830-1b31a7b51fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:12.696867 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6640f18c-acea-4335-a830-1b31a7b51fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:12.697673 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6640f18c-acea-4335-a830-1b31a7b51fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:12.698275 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6640f18c-acea-4335-a830-1b31a7b51fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:12.699328 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6640f18c-acea-4335-a830-1b31a7b51fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:12.699975 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6640f18c-acea-4335-a830-1b31a7b51fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:12.700561 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6640f18c-acea-4335-a830-1b31a7b51fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:13.584096 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2d617ba4-2caa-430f-8262-ccecec714526 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:13.601744 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2d617ba4-2caa-430f-8262-ccecec714526 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 1.365835 Aug 22 17:27:13.617631 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 32/74] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:12 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:13.635593 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1e686274-c501-4e46-a223-c9809a389d75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:13.636665 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1e686274-c501-4e46-a223-c9809a389d75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:13.644679 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1e686274-c501-4e46-a223-c9809a389d75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:13.645533 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1e686274-c501-4e46-a223-c9809a389d75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:13.646354 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1e686274-c501-4e46-a223-c9809a389d75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:13.647421 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1e686274-c501-4e46-a223-c9809a389d75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:13.648149 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1e686274-c501-4e46-a223-c9809a389d75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:13.649515 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1e686274-c501-4e46-a223-c9809a389d75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:14.138341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6640f18c-acea-4335-a830-1b31a7b51fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:14.174795 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6640f18c-acea-4335-a830-1b31a7b51fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:14.178975 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6640f18c-acea-4335-a830-1b31a7b51fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:14.189336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6640f18c-acea-4335-a830-1b31a7b51fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 1.516835 Aug 22 17:27:14.203792 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 43/75] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:12 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 1533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:14.228961 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8e94db5b-eb4b-43a5-93a5-60065b518340 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:14.231062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8e94db5b-eb4b-43a5-93a5-60065b518340 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:14.251423 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:14.256629 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8e94db5b-eb4b-43a5-93a5-60065b518340 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:14.258562 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8e94db5b-eb4b-43a5-93a5-60065b518340 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:14.259826 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8e94db5b-eb4b-43a5-93a5-60065b518340 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:14.262319 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8e94db5b-eb4b-43a5-93a5-60065b518340 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:14.263676 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8e94db5b-eb4b-43a5-93a5-60065b518340 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:14.265353 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8e94db5b-eb4b-43a5-93a5-60065b518340 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:14.645412 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1e686274-c501-4e46-a223-c9809a389d75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:14.665313 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1e686274-c501-4e46-a223-c9809a389d75 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 1.034228 Aug 22 17:27:14.666104 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 33/76] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:13 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:14.678091 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5c01b544-16d5-4f39-929e-f0e3d42e6595 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:14.682818 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5c01b544-16d5-4f39-929e-f0e3d42e6595 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:14.694659 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c01b544-16d5-4f39-929e-f0e3d42e6595 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:14.695578 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c01b544-16d5-4f39-929e-f0e3d42e6595 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:14.696294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c01b544-16d5-4f39-929e-f0e3d42e6595 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:14.698618 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c01b544-16d5-4f39-929e-f0e3d42e6595 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:14.700047 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c01b544-16d5-4f39-929e-f0e3d42e6595 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:14.700866 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c01b544-16d5-4f39-929e-f0e3d42e6595 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:14.774258 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8e94db5b-eb4b-43a5-93a5-60065b518340 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:14.814926 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8e94db5b-eb4b-43a5-93a5-60065b518340 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.599665 Aug 22 17:27:14.814926 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 44/77] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:14 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:15.236660 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-780f1d15-8f0c-42f3-9841-15b10a51890b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:15.240200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-780f1d15-8f0c-42f3-9841-15b10a51890b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:15.263800 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-780f1d15-8f0c-42f3-9841-15b10a51890b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:15.265757 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-780f1d15-8f0c-42f3-9841-15b10a51890b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:15.266723 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-780f1d15-8f0c-42f3-9841-15b10a51890b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:15.268224 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-780f1d15-8f0c-42f3-9841-15b10a51890b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:15.268960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-780f1d15-8f0c-42f3-9841-15b10a51890b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:15.269669 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-780f1d15-8f0c-42f3-9841-15b10a51890b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:15.524578 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5c01b544-16d5-4f39-929e-f0e3d42e6595 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:15.576807 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5c01b544-16d5-4f39-929e-f0e3d42e6595 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.905381 Aug 22 17:27:15.582315 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 34/78] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:14 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:15.697771 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-986ce7cc-73de-47d4-bacd-30e63610f1cd tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:15.699266 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-986ce7cc-73de-47d4-bacd-30e63610f1cd tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:15.723637 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-986ce7cc-73de-47d4-bacd-30e63610f1cd tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:15.726077 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-986ce7cc-73de-47d4-bacd-30e63610f1cd tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:15.727064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-986ce7cc-73de-47d4-bacd-30e63610f1cd tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:15.730707 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-986ce7cc-73de-47d4-bacd-30e63610f1cd tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:15.733272 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-986ce7cc-73de-47d4-bacd-30e63610f1cd tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:15.734309 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-986ce7cc-73de-47d4-bacd-30e63610f1cd tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:15.830363 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-780f1d15-8f0c-42f3-9841-15b10a51890b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:15.848181 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-780f1d15-8f0c-42f3-9841-15b10a51890b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:15.853388 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-780f1d15-8f0c-42f3-9841-15b10a51890b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:15.856595 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-780f1d15-8f0c-42f3-9841-15b10a51890b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.626345 Aug 22 17:27:15.859819 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 45/79] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:15 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:15.874804 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-44bac387-76b7-4948-b2c4-1b12b67525e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:15.874804 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-44bac387-76b7-4948-b2c4-1b12b67525e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:15.897760 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-44bac387-76b7-4948-b2c4-1b12b67525e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:15.898641 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-44bac387-76b7-4948-b2c4-1b12b67525e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:15.901108 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-44bac387-76b7-4948-b2c4-1b12b67525e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:15.902094 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-44bac387-76b7-4948-b2c4-1b12b67525e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:15.902783 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-44bac387-76b7-4948-b2c4-1b12b67525e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:15.904000 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-44bac387-76b7-4948-b2c4-1b12b67525e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:16.229047 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-44bac387-76b7-4948-b2c4-1b12b67525e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:16.238282 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-44bac387-76b7-4948-b2c4-1b12b67525e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.374106 Aug 22 17:27:16.241722 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 46/80] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:15 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:16.399337 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-e38f24f6-98f9-42d5-9d7a-936e8a673058 req-a22d0b22-df22-4911-8435-ee020a708bcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcb3959b-fd48-4a97-81d0-5b74ec4cfd32", "tag": "703038a4-7ff6-4222-b6d6-2865ce69bda5"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:27:16.468568 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-e38f24f6-98f9-42d5-9d7a-936e8a673058 req-a22d0b22-df22-4911-8435-ee020a708bcb service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:16.468568 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-e38f24f6-98f9-42d5-9d7a-936e8a673058 req-a22d0b22-df22-4911-8435-ee020a708bcb service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:16.468568 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-e38f24f6-98f9-42d5-9d7a-936e8a673058 req-a22d0b22-df22-4911-8435-ee020a708bcb service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:16.512556 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-e38f24f6-98f9-42d5-9d7a-936e8a673058 req-a22d0b22-df22-4911-8435-ee020a708bcb service nova] Creating event network-changed:703038a4-7ff6-4222-b6d6-2865ce69bda5 for instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 on hv-cinder-85394 Aug 22 17:27:16.515210 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-e38f24f6-98f9-42d5-9d7a-936e8a673058 req-a22d0b22-df22-4911-8435-ee020a708bcb service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121852) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 22 17:27:16.516335 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-e38f24f6-98f9-42d5-9d7a-936e8a673058 req-a22d0b22-df22-4911-8435-ee020a708bcb service nova] Acquired lock "compute-rpcapi-router" {{(pid=121852) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 22 17:27:16.518755 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e3f2f6c-9055-49e9-b718-d6d6b7cc43a3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:16.520171 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e3f2f6c-9055-49e9-b718-d6d6b7cc43a3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:16.522789 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e3f2f6c-9055-49e9-b718-d6d6b7cc43a3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:16.524407 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e3f2f6c-9055-49e9-b718-d6d6b7cc43a3 None None] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:16.525855 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e3f2f6c-9055-49e9-b718-d6d6b7cc43a3 None None] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:16.526935 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e3f2f6c-9055-49e9-b718-d6d6b7cc43a3 None None] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:16.549996 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.compute.rpcapi [None req-4e3f2f6c-9055-49e9-b718-d6d6b7cc43a3 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 22 17:27:16.555409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e3f2f6c-9055-49e9-b718-d6d6b7cc43a3 None None] Releasing lock "compute-rpcapi-router" {{(pid=121852) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 22 17:27:16.622666 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4e3f2f6c-9055-49e9-b718-d6d6b7cc43a3 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.371563 Aug 22 17:27:16.628710 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 47/81] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:27:16.839050 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-01b610b9-8808-49ad-ac40-bcbe17ba55e4 req-d5f26295-63e3-40f3-ab1a-0f6362eac959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c1f97f-c673-4f7b-8ecf-45396ce57516", "tag": "acf48248-cd4c-42ff-9f56-03f04156294f"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:27:16.876229 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-986ce7cc-73de-47d4-bacd-30e63610f1cd tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:16.886720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-01b610b9-8808-49ad-ac40-bcbe17ba55e4 req-d5f26295-63e3-40f3-ab1a-0f6362eac959 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:16.887963 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-01b610b9-8808-49ad-ac40-bcbe17ba55e4 req-d5f26295-63e3-40f3-ab1a-0f6362eac959 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:16.892376 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-01b610b9-8808-49ad-ac40-bcbe17ba55e4 req-d5f26295-63e3-40f3-ab1a-0f6362eac959 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:16.903823 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-986ce7cc-73de-47d4-bacd-30e63610f1cd tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 1.210813 Aug 22 17:27:16.907462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 35/82] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:15 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:16.934305 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2aa29003-a2ea-42a0-b9d2-04df1801afc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:16.941136 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2aa29003-a2ea-42a0-b9d2-04df1801afc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:16.961881 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-01b610b9-8808-49ad-ac40-bcbe17ba55e4 req-d5f26295-63e3-40f3-ab1a-0f6362eac959 service nova] Creating event network-changed:acf48248-cd4c-42ff-9f56-03f04156294f for instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 on hv-cinder-85394 Aug 22 17:27:16.975228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2aa29003-a2ea-42a0-b9d2-04df1801afc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:16.985743 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2aa29003-a2ea-42a0-b9d2-04df1801afc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:16.987461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-01b610b9-8808-49ad-ac40-bcbe17ba55e4 req-d5f26295-63e3-40f3-ab1a-0f6362eac959 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.349963 Aug 22 17:27:16.990238 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2aa29003-a2ea-42a0-b9d2-04df1801afc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:16.992267 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 48/83] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:27:16.999240 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2aa29003-a2ea-42a0-b9d2-04df1801afc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:17.006660 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2aa29003-a2ea-42a0-b9d2-04df1801afc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:17.012360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-95243dd5-3f3e-47e1-a163-e3558fd67be2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:17.014725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2aa29003-a2ea-42a0-b9d2-04df1801afc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:17.015616 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-95243dd5-3f3e-47e1-a163-e3558fd67be2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:17.051250 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95243dd5-3f3e-47e1-a163-e3558fd67be2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:17.053954 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95243dd5-3f3e-47e1-a163-e3558fd67be2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:17.054665 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95243dd5-3f3e-47e1-a163-e3558fd67be2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:17.058217 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95243dd5-3f3e-47e1-a163-e3558fd67be2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:17.059013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95243dd5-3f3e-47e1-a163-e3558fd67be2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:17.059495 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95243dd5-3f3e-47e1-a163-e3558fd67be2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:17.505380 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-95243dd5-3f3e-47e1-a163-e3558fd67be2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:17.517839 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-95243dd5-3f3e-47e1-a163-e3558fd67be2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:17.527735 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-95243dd5-3f3e-47e1-a163-e3558fd67be2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:17.527735 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-95243dd5-3f3e-47e1-a163-e3558fd67be2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.526805 Aug 22 17:27:17.527735 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 49/84] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:16 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:17.542248 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8892d898-c94f-48dd-b767-f000841e0771 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:17.546837 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8892d898-c94f-48dd-b767-f000841e0771 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:17.555270 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8892d898-c94f-48dd-b767-f000841e0771 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:17.555977 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8892d898-c94f-48dd-b767-f000841e0771 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:17.556530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8892d898-c94f-48dd-b767-f000841e0771 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:17.557626 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8892d898-c94f-48dd-b767-f000841e0771 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:17.558241 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8892d898-c94f-48dd-b767-f000841e0771 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:17.558830 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8892d898-c94f-48dd-b767-f000841e0771 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:17.635820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2aa29003-a2ea-42a0-b9d2-04df1801afc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:17.650777 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2aa29003-a2ea-42a0-b9d2-04df1801afc5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.741042 Aug 22 17:27:17.654717 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 36/85] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:16 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:17.781687 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8892d898-c94f-48dd-b767-f000841e0771 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:17.791590 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8892d898-c94f-48dd-b767-f000841e0771 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.266296 Aug 22 17:27:17.792193 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 50/86] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:17 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:17.954258 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-866e6130-69bf-4c60-8606-578940ea4c6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:17.955457 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-866e6130-69bf-4c60-8606-578940ea4c6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:17.966474 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866e6130-69bf-4c60-8606-578940ea4c6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:17.967006 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866e6130-69bf-4c60-8606-578940ea4c6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:17.971163 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866e6130-69bf-4c60-8606-578940ea4c6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:17.975501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866e6130-69bf-4c60-8606-578940ea4c6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:17.976217 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866e6130-69bf-4c60-8606-578940ea4c6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:17.976685 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866e6130-69bf-4c60-8606-578940ea4c6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:18.517999 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-866e6130-69bf-4c60-8606-578940ea4c6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:18.527652 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-866e6130-69bf-4c60-8606-578940ea4c6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.580922 Aug 22 17:27:18.528289 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 37/87] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:17 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:18.560940 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-439d9219-380c-47e9-b86d-eee3ec3de37f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:18.560940 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-439d9219-380c-47e9-b86d-eee3ec3de37f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:18.572453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-439d9219-380c-47e9-b86d-eee3ec3de37f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:18.573336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-439d9219-380c-47e9-b86d-eee3ec3de37f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:18.574141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-439d9219-380c-47e9-b86d-eee3ec3de37f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:18.575455 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-439d9219-380c-47e9-b86d-eee3ec3de37f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:18.576479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-439d9219-380c-47e9-b86d-eee3ec3de37f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:18.577184 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-439d9219-380c-47e9-b86d-eee3ec3de37f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:18.671648 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-056b6603-39fb-46b2-aff7-4e0835ef0f3a req-28fd8548-d5e2-45a7-8074-a9be932f570c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4763726-f1d6-476a-b919-ad30acd9fcc4", "tag": "0dda04d1-36ae-4c21-ac5d-063913579bea"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:27:18.697776 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-056b6603-39fb-46b2-aff7-4e0835ef0f3a req-28fd8548-d5e2-45a7-8074-a9be932f570c service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:18.698714 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-056b6603-39fb-46b2-aff7-4e0835ef0f3a req-28fd8548-d5e2-45a7-8074-a9be932f570c service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:18.699513 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-056b6603-39fb-46b2-aff7-4e0835ef0f3a req-28fd8548-d5e2-45a7-8074-a9be932f570c service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:18.753407 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-056b6603-39fb-46b2-aff7-4e0835ef0f3a req-28fd8548-d5e2-45a7-8074-a9be932f570c service nova] Creating event network-changed:0dda04d1-36ae-4c21-ac5d-063913579bea for instance e4763726-f1d6-476a-b919-ad30acd9fcc4 on hv-cinder-85394 Aug 22 17:27:18.756906 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-056b6603-39fb-46b2-aff7-4e0835ef0f3a req-28fd8548-d5e2-45a7-8074-a9be932f570c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121853) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 22 17:27:18.757971 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-056b6603-39fb-46b2-aff7-4e0835ef0f3a req-28fd8548-d5e2-45a7-8074-a9be932f570c service nova] Acquired lock "compute-rpcapi-router" {{(pid=121853) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 22 17:27:18.762146 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b9d60537-0141-4aa0-936c-0bbfe6280ab9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:18.773109 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b9d60537-0141-4aa0-936c-0bbfe6280ab9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:18.773109 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b9d60537-0141-4aa0-936c-0bbfe6280ab9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:18.775285 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b9d60537-0141-4aa0-936c-0bbfe6280ab9 None None] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:18.778364 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b9d60537-0141-4aa0-936c-0bbfe6280ab9 None None] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:18.780549 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b9d60537-0141-4aa0-936c-0bbfe6280ab9 None None] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:18.810733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.compute.rpcapi [None req-b9d60537-0141-4aa0-936c-0bbfe6280ab9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 22 17:27:18.812206 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b9d60537-0141-4aa0-936c-0bbfe6280ab9 None None] Releasing lock "compute-rpcapi-router" {{(pid=121853) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 22 17:27:18.849924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b9d60537-0141-4aa0-936c-0bbfe6280ab9 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181332 Aug 22 17:27:18.851952 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 38/88] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:27:18.860695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0c821281-cd6e-4525-85ba-956d784d0be9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:18.861753 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0c821281-cd6e-4525-85ba-956d784d0be9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:18.873990 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0c821281-cd6e-4525-85ba-956d784d0be9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:18.875350 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0c821281-cd6e-4525-85ba-956d784d0be9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:18.876023 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0c821281-cd6e-4525-85ba-956d784d0be9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:18.877079 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0c821281-cd6e-4525-85ba-956d784d0be9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:18.877789 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0c821281-cd6e-4525-85ba-956d784d0be9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:18.878462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0c821281-cd6e-4525-85ba-956d784d0be9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:18.935047 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-439d9219-380c-47e9-b86d-eee3ec3de37f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:18.947219 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-439d9219-380c-47e9-b86d-eee3ec3de37f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:18.961493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-439d9219-380c-47e9-b86d-eee3ec3de37f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:18.963043 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-439d9219-380c-47e9-b86d-eee3ec3de37f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.412246 Aug 22 17:27:18.963607 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 51/89] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:18 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:18.968640 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ff879721-07a9-4d1d-acc2-891bf51723c2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:18.969151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ff879721-07a9-4d1d-acc2-891bf51723c2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:18.990192 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff879721-07a9-4d1d-acc2-891bf51723c2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:18.991071 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff879721-07a9-4d1d-acc2-891bf51723c2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:18.991613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff879721-07a9-4d1d-acc2-891bf51723c2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:18.992461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff879721-07a9-4d1d-acc2-891bf51723c2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:18.992975 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff879721-07a9-4d1d-acc2-891bf51723c2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:18.993397 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff879721-07a9-4d1d-acc2-891bf51723c2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:19.132152 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0c821281-cd6e-4525-85ba-956d784d0be9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:19.142464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0c821281-cd6e-4525-85ba-956d784d0be9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.288529 Aug 22 17:27:19.143306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 39/90] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:18 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:19.151517 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-9c0f2ff8-82bf-4aca-bf20-4edaefba0c65 req-0ef342ed-ec4f-49c9-9aa7-b9931d56b63d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb123a58-2326-45c2-8c47-e297dd1d60c2", "tag": "d2251451-3cf4-4bc2-94f0-b88d3e3158ae"}, {"name": "network-changed", "server_uuid": "66262c8d-0245-4a3f-83e8-d3093c6d1057", "tag": "162afc48-12ea-4a69-b48b-a1d677b0c796"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:27:19.163280 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-9c0f2ff8-82bf-4aca-bf20-4edaefba0c65 req-0ef342ed-ec4f-49c9-9aa7-b9931d56b63d service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:19.163755 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-9c0f2ff8-82bf-4aca-bf20-4edaefba0c65 req-0ef342ed-ec4f-49c9-9aa7-b9931d56b63d service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:19.164358 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-9c0f2ff8-82bf-4aca-bf20-4edaefba0c65 req-0ef342ed-ec4f-49c9-9aa7-b9931d56b63d service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:19.183447 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-9c0f2ff8-82bf-4aca-bf20-4edaefba0c65 req-0ef342ed-ec4f-49c9-9aa7-b9931d56b63d service nova] Creating event network-changed:d2251451-3cf4-4bc2-94f0-b88d3e3158ae for instance eb123a58-2326-45c2-8c47-e297dd1d60c2 on hv-cinder-85394 Aug 22 17:27:19.184397 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-9c0f2ff8-82bf-4aca-bf20-4edaefba0c65 req-0ef342ed-ec4f-49c9-9aa7-b9931d56b63d service nova] Creating event network-changed:162afc48-12ea-4a69-b48b-a1d677b0c796 for instance 66262c8d-0245-4a3f-83e8-d3093c6d1057 on hv-cinder-85394 Aug 22 17:27:19.196781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-9c0f2ff8-82bf-4aca-bf20-4edaefba0c65 req-0ef342ed-ec4f-49c9-9aa7-b9931d56b63d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.051552 Aug 22 17:27:19.198472 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 40/91] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:27:19.256866 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ff879721-07a9-4d1d-acc2-891bf51723c2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:19.270029 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ff879721-07a9-4d1d-acc2-891bf51723c2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.305023 Aug 22 17:27:19.272747 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 52/92] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:18 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:19.563417 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-9ae95896-79ac-445b-b86a-b7252e19441a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:19.564241 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9ae95896-79ac-445b-b86a-b7252e19441a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:19.578657 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ae95896-79ac-445b-b86a-b7252e19441a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:19.580082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ae95896-79ac-445b-b86a-b7252e19441a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:19.580082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ae95896-79ac-445b-b86a-b7252e19441a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:19.580471 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ae95896-79ac-445b-b86a-b7252e19441a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:19.580962 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ae95896-79ac-445b-b86a-b7252e19441a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:19.581401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ae95896-79ac-445b-b86a-b7252e19441a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:19.743930 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-9ae95896-79ac-445b-b86a-b7252e19441a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:19.754024 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-9ae95896-79ac-445b-b86a-b7252e19441a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.195872 Aug 22 17:27:19.756567 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 41/93] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:19 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:20.012284 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6d588098-5ed2-4b73-8ca1-29195114c3ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:20.013176 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6d588098-5ed2-4b73-8ca1-29195114c3ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:20.020217 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d588098-5ed2-4b73-8ca1-29195114c3ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:20.020720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d588098-5ed2-4b73-8ca1-29195114c3ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:20.021685 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d588098-5ed2-4b73-8ca1-29195114c3ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:20.022511 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d588098-5ed2-4b73-8ca1-29195114c3ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:20.022919 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d588098-5ed2-4b73-8ca1-29195114c3ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:20.023344 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d588098-5ed2-4b73-8ca1-29195114c3ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:20.185442 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-96445c49-6f32-4b77-83e1-34f3b103cda1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:20.186735 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-96445c49-6f32-4b77-83e1-34f3b103cda1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:20.197343 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96445c49-6f32-4b77-83e1-34f3b103cda1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:20.198206 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96445c49-6f32-4b77-83e1-34f3b103cda1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:20.198871 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96445c49-6f32-4b77-83e1-34f3b103cda1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:20.199874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96445c49-6f32-4b77-83e1-34f3b103cda1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:20.200568 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96445c49-6f32-4b77-83e1-34f3b103cda1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:20.201219 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96445c49-6f32-4b77-83e1-34f3b103cda1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:20.464857 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6d588098-5ed2-4b73-8ca1-29195114c3ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:20.488507 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6d588098-5ed2-4b73-8ca1-29195114c3ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:20.492301 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6d588098-5ed2-4b73-8ca1-29195114c3ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:20.495083 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6d588098-5ed2-4b73-8ca1-29195114c3ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.486671 Aug 22 17:27:20.496819 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 53/94] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:20 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:20.517443 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2ccff959-936d-49ac-9682-4f5f4a481837 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:20.528672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-2ccff959-936d-49ac-9682-4f5f4a481837 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:20.545339 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ccff959-936d-49ac-9682-4f5f4a481837 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:20.546209 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ccff959-936d-49ac-9682-4f5f4a481837 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:20.547011 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ccff959-936d-49ac-9682-4f5f4a481837 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:20.557978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ccff959-936d-49ac-9682-4f5f4a481837 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:20.558946 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ccff959-936d-49ac-9682-4f5f4a481837 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:20.560112 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ccff959-936d-49ac-9682-4f5f4a481837 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:20.697957 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-96445c49-6f32-4b77-83e1-34f3b103cda1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:20.725048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-96445c49-6f32-4b77-83e1-34f3b103cda1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.544577 Aug 22 17:27:20.727949 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 42/95] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:20 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:20.794024 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e885aaf1-46e0-49e4-807b-b9041756aa2d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:20.798696 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e885aaf1-46e0-49e4-807b-b9041756aa2d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:20.819253 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e885aaf1-46e0-49e4-807b-b9041756aa2d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:20.819946 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e885aaf1-46e0-49e4-807b-b9041756aa2d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:20.820660 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e885aaf1-46e0-49e4-807b-b9041756aa2d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:20.821691 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e885aaf1-46e0-49e4-807b-b9041756aa2d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:20.822390 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e885aaf1-46e0-49e4-807b-b9041756aa2d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:20.823385 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e885aaf1-46e0-49e4-807b-b9041756aa2d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:20.969977 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2ccff959-936d-49ac-9682-4f5f4a481837 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:21.007432 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2ccff959-936d-49ac-9682-4f5f4a481837 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.504725 Aug 22 17:27:21.008581 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 54/96] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:20 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:21.431768 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e885aaf1-46e0-49e4-807b-b9041756aa2d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:21.445452 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e885aaf1-46e0-49e4-807b-b9041756aa2d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.660448 Aug 22 17:27:21.447412 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 43/97] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:20 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:21.539055 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-91539ec0-5d9e-4420-b771-06a35bd12dd7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:21.550795 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-91539ec0-5d9e-4420-b771-06a35bd12dd7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:21.571638 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-91539ec0-5d9e-4420-b771-06a35bd12dd7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:21.572480 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-91539ec0-5d9e-4420-b771-06a35bd12dd7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:21.573220 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-91539ec0-5d9e-4420-b771-06a35bd12dd7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:21.599588 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-91539ec0-5d9e-4420-b771-06a35bd12dd7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:21.608002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-91539ec0-5d9e-4420-b771-06a35bd12dd7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:21.609256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-91539ec0-5d9e-4420-b771-06a35bd12dd7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:21.757577 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=100 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:21.767717 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c4db7214-e7f2-439c-8f79-4cce897af45b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:21.768783 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c4db7214-e7f2-439c-8f79-4cce897af45b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:21.780939 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c4db7214-e7f2-439c-8f79-4cce897af45b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:21.783019 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c4db7214-e7f2-439c-8f79-4cce897af45b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:21.784966 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c4db7214-e7f2-439c-8f79-4cce897af45b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:21.791871 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c4db7214-e7f2-439c-8f79-4cce897af45b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:21.793885 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c4db7214-e7f2-439c-8f79-4cce897af45b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:21.796085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c4db7214-e7f2-439c-8f79-4cce897af45b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:22.393594 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-91539ec0-5d9e-4420-b771-06a35bd12dd7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:22.453355 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-91539ec0-5d9e-4420-b771-06a35bd12dd7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:22.461280 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-91539ec0-5d9e-4420-b771-06a35bd12dd7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:22.473363 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-91539ec0-5d9e-4420-b771-06a35bd12dd7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.950440 Aug 22 17:27:22.480395 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 55/98] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:21 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:27:22.503896 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f657044c-9e17-4919-8ea9-dc0dc83d8214 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:22.511597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f657044c-9e17-4919-8ea9-dc0dc83d8214 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:22.543338 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f657044c-9e17-4919-8ea9-dc0dc83d8214 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:22.553213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f657044c-9e17-4919-8ea9-dc0dc83d8214 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:22.556952 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f657044c-9e17-4919-8ea9-dc0dc83d8214 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:22.558352 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f657044c-9e17-4919-8ea9-dc0dc83d8214 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:22.559361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f657044c-9e17-4919-8ea9-dc0dc83d8214 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:22.560028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f657044c-9e17-4919-8ea9-dc0dc83d8214 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:22.936732 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c4db7214-e7f2-439c-8f79-4cce897af45b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:22.944640 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c4db7214-e7f2-439c-8f79-4cce897af45b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 1.176111 Aug 22 17:27:22.946066 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 44/99] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:21 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:22.951494 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8b11877b-a840-4965-bfe1-44033c851de5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:22.952093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8b11877b-a840-4965-bfe1-44033c851de5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:22.970232 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8b11877b-a840-4965-bfe1-44033c851de5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:22.977971 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8b11877b-a840-4965-bfe1-44033c851de5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:22.984728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8b11877b-a840-4965-bfe1-44033c851de5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:22.985685 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8b11877b-a840-4965-bfe1-44033c851de5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:22.987075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8b11877b-a840-4965-bfe1-44033c851de5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:22.988658 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8b11877b-a840-4965-bfe1-44033c851de5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:23.998563 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8b11877b-a840-4965-bfe1-44033c851de5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:24.007929 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8b11877b-a840-4965-bfe1-44033c851de5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 1.060559 Aug 22 17:27:24.013108 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 45/100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:22 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:24.024124 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f48cc30f-c1f8-4807-959d-b246a020f447 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:24.028224 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f48cc30f-c1f8-4807-959d-b246a020f447 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:24.057582 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f48cc30f-c1f8-4807-959d-b246a020f447 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:24.061786 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f48cc30f-c1f8-4807-959d-b246a020f447 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:24.062314 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f48cc30f-c1f8-4807-959d-b246a020f447 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:24.063226 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f48cc30f-c1f8-4807-959d-b246a020f447 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:24.064506 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f48cc30f-c1f8-4807-959d-b246a020f447 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:24.067869 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f48cc30f-c1f8-4807-959d-b246a020f447 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:24.249342 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f657044c-9e17-4919-8ea9-dc0dc83d8214 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:24.270038 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f657044c-9e17-4919-8ea9-dc0dc83d8214 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 1.784820 Aug 22 17:27:24.272148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 56/101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:22 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 1790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:24.289390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-89328361-056c-4568-9681-a957d49a985a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:24.290299 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-89328361-056c-4568-9681-a957d49a985a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:24.307937 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89328361-056c-4568-9681-a957d49a985a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:24.308697 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89328361-056c-4568-9681-a957d49a985a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:24.309312 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89328361-056c-4568-9681-a957d49a985a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:24.311924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89328361-056c-4568-9681-a957d49a985a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:24.312644 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89328361-056c-4568-9681-a957d49a985a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:24.313239 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89328361-056c-4568-9681-a957d49a985a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:24.574987 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f48cc30f-c1f8-4807-959d-b246a020f447 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:24.588080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f48cc30f-c1f8-4807-959d-b246a020f447 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:24.593657 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f48cc30f-c1f8-4807-959d-b246a020f447 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:24.595295 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f48cc30f-c1f8-4807-959d-b246a020f447 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.578892 Aug 22 17:27:24.596143 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 46/102] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:24 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:24.824066 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-89328361-056c-4568-9681-a957d49a985a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:24.835490 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-89328361-056c-4568-9681-a957d49a985a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.561306 Aug 22 17:27:24.836410 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 57/103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:24 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:25.038367 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-191119b7-fcc7-440e-9808-7d2523bf8e20 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:25.039053 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-191119b7-fcc7-440e-9808-7d2523bf8e20 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:25.046357 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-191119b7-fcc7-440e-9808-7d2523bf8e20 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:25.047097 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-191119b7-fcc7-440e-9808-7d2523bf8e20 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:25.047698 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-191119b7-fcc7-440e-9808-7d2523bf8e20 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:25.048708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-191119b7-fcc7-440e-9808-7d2523bf8e20 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:25.049253 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-191119b7-fcc7-440e-9808-7d2523bf8e20 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:25.049753 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-191119b7-fcc7-440e-9808-7d2523bf8e20 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:25.055560 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=100 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:25.278773 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-191119b7-fcc7-440e-9808-7d2523bf8e20 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:25.295972 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-191119b7-fcc7-440e-9808-7d2523bf8e20 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.269708 Aug 22 17:27:25.297936 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 47/104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:25 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:25.300484 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-1eb91cda-5176-4692-9765-9dcd4994f993 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:25.301579 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-1eb91cda-5176-4692-9765-9dcd4994f993 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:25.318870 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1eb91cda-5176-4692-9765-9dcd4994f993 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:25.319735 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1eb91cda-5176-4692-9765-9dcd4994f993 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:25.320490 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1eb91cda-5176-4692-9765-9dcd4994f993 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:25.321549 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1eb91cda-5176-4692-9765-9dcd4994f993 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:25.322224 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1eb91cda-5176-4692-9765-9dcd4994f993 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:25.327746 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1eb91cda-5176-4692-9765-9dcd4994f993 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:25.544205 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-1eb91cda-5176-4692-9765-9dcd4994f993 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:25.554198 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-1eb91cda-5176-4692-9765-9dcd4994f993 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.262066 Aug 22 17:27:25.567333 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 58/105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:25 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:25.628643 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c000aa95-ac9e-454c-84b0-abf1c4a777a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:25.846042 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c000aa95-ac9e-454c-84b0-abf1c4a777a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:25.846042 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c000aa95-ac9e-454c-84b0-abf1c4a777a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:25.846042 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c000aa95-ac9e-454c-84b0-abf1c4a777a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:25.846042 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c000aa95-ac9e-454c-84b0-abf1c4a777a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:25.850380 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c000aa95-ac9e-454c-84b0-abf1c4a777a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:25.850380 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c000aa95-ac9e-454c-84b0-abf1c4a777a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:25.850380 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c000aa95-ac9e-454c-84b0-abf1c4a777a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:25.865912 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-165146ab-770a-491d-bffa-30b04016e33c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:25.867278 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c000aa95-ac9e-454c-84b0-abf1c4a777a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:25.867597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-165146ab-770a-491d-bffa-30b04016e33c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:25.877215 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c000aa95-ac9e-454c-84b0-abf1c4a777a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:25.878897 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c000aa95-ac9e-454c-84b0-abf1c4a777a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:25.879082 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-165146ab-770a-491d-bffa-30b04016e33c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:25.879764 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-165146ab-770a-491d-bffa-30b04016e33c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:25.880192 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c000aa95-ac9e-454c-84b0-abf1c4a777a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.260268 Aug 22 17:27:25.881242 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-165146ab-770a-491d-bffa-30b04016e33c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:25.885238 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 48/106] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:25 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:25.885527 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-165146ab-770a-491d-bffa-30b04016e33c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:25.885527 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-165146ab-770a-491d-bffa-30b04016e33c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:25.885527 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-165146ab-770a-491d-bffa-30b04016e33c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:26.080144 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-165146ab-770a-491d-bffa-30b04016e33c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:26.094943 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-165146ab-770a-491d-bffa-30b04016e33c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.237309 Aug 22 17:27:26.095926 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 59/107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:25 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:26.333748 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-da01d326-9341-4dae-b675-c5411c25bb94 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:26.333748 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-da01d326-9341-4dae-b675-c5411c25bb94 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:26.341100 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-da01d326-9341-4dae-b675-c5411c25bb94 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:26.341906 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-da01d326-9341-4dae-b675-c5411c25bb94 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:26.342699 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-da01d326-9341-4dae-b675-c5411c25bb94 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:26.343885 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-da01d326-9341-4dae-b675-c5411c25bb94 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:26.344637 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-da01d326-9341-4dae-b675-c5411c25bb94 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:26.345393 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-da01d326-9341-4dae-b675-c5411c25bb94 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:26.577471 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-7ace50b2-3d55-4a26-854e-b8b0a429420a tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:26.578269 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-7ace50b2-3d55-4a26-854e-b8b0a429420a tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:26.584817 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-da01d326-9341-4dae-b675-c5411c25bb94 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:26.585130 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:26.586714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7ace50b2-3d55-4a26-854e-b8b0a429420a tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:26.587434 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7ace50b2-3d55-4a26-854e-b8b0a429420a tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:26.588068 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7ace50b2-3d55-4a26-854e-b8b0a429420a tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:26.589103 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7ace50b2-3d55-4a26-854e-b8b0a429420a tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:26.589734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7ace50b2-3d55-4a26-854e-b8b0a429420a tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:26.590307 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7ace50b2-3d55-4a26-854e-b8b0a429420a tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:26.597391 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-da01d326-9341-4dae-b675-c5411c25bb94 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.269803 Aug 22 17:27:26.607716 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 49/108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:26 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:26.829898 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-7ace50b2-3d55-4a26-854e-b8b0a429420a tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:26.843208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-7ace50b2-3d55-4a26-854e-b8b0a429420a tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.269422 Aug 22 17:27:26.858974 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 60/109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:26 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:26.908995 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-80703c69-96c4-4bbb-93fb-0d95557813ac tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:26.910002 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-80703c69-96c4-4bbb-93fb-0d95557813ac tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:26.918675 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-80703c69-96c4-4bbb-93fb-0d95557813ac tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:26.919292 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-80703c69-96c4-4bbb-93fb-0d95557813ac tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:26.921620 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-80703c69-96c4-4bbb-93fb-0d95557813ac tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:26.921620 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-80703c69-96c4-4bbb-93fb-0d95557813ac tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:26.921620 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-80703c69-96c4-4bbb-93fb-0d95557813ac tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:26.922025 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-80703c69-96c4-4bbb-93fb-0d95557813ac tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:27.112415 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-80703c69-96c4-4bbb-93fb-0d95557813ac tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:27.124634 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-542fe668-0a5f-4023-a63c-cb292dbff2e8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:27.126690 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-542fe668-0a5f-4023-a63c-cb292dbff2e8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:27.128835 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-80703c69-96c4-4bbb-93fb-0d95557813ac tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:27.133971 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-80703c69-96c4-4bbb-93fb-0d95557813ac tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:27.136060 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-80703c69-96c4-4bbb-93fb-0d95557813ac tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.232934 Aug 22 17:27:27.137471 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 50/110] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:26 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:27.167470 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-542fe668-0a5f-4023-a63c-cb292dbff2e8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:27.176040 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-542fe668-0a5f-4023-a63c-cb292dbff2e8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:27.176841 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-542fe668-0a5f-4023-a63c-cb292dbff2e8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:27.180195 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-542fe668-0a5f-4023-a63c-cb292dbff2e8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:27.181097 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-542fe668-0a5f-4023-a63c-cb292dbff2e8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:27.182098 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-542fe668-0a5f-4023-a63c-cb292dbff2e8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:27.402660 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-542fe668-0a5f-4023-a63c-cb292dbff2e8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:27.420942 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-542fe668-0a5f-4023-a63c-cb292dbff2e8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.301685 Aug 22 17:27:27.420942 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 61/111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:27 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:27.633163 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0b435def-5c49-49f2-a9bd-3c2bd2e49f46 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:27.634430 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0b435def-5c49-49f2-a9bd-3c2bd2e49f46 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:27.645764 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0b435def-5c49-49f2-a9bd-3c2bd2e49f46 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:27.646089 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0b435def-5c49-49f2-a9bd-3c2bd2e49f46 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:27.648126 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0b435def-5c49-49f2-a9bd-3c2bd2e49f46 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:27.649890 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0b435def-5c49-49f2-a9bd-3c2bd2e49f46 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:27.650633 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0b435def-5c49-49f2-a9bd-3c2bd2e49f46 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:27.651314 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0b435def-5c49-49f2-a9bd-3c2bd2e49f46 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:27.862686 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0b435def-5c49-49f2-a9bd-3c2bd2e49f46 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:27.877219 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-1a676cb7-bff3-4c3e-86bc-70f07fcf29d0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:27.879816 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-1a676cb7-bff3-4c3e-86bc-70f07fcf29d0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:27.885678 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0b435def-5c49-49f2-a9bd-3c2bd2e49f46 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.267916 Aug 22 17:27:27.887126 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 51/112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:27 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:27.904398 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1a676cb7-bff3-4c3e-86bc-70f07fcf29d0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:27.909894 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1a676cb7-bff3-4c3e-86bc-70f07fcf29d0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:27.909894 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1a676cb7-bff3-4c3e-86bc-70f07fcf29d0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:27.909894 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1a676cb7-bff3-4c3e-86bc-70f07fcf29d0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:27.909894 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1a676cb7-bff3-4c3e-86bc-70f07fcf29d0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:27.910549 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1a676cb7-bff3-4c3e-86bc-70f07fcf29d0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:28.151812 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-1a676cb7-bff3-4c3e-86bc-70f07fcf29d0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:28.164735 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-1a676cb7-bff3-4c3e-86bc-70f07fcf29d0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.294803 Aug 22 17:27:28.165882 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 62/113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:27 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:28.201825 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e48120f8-0720-4d30-a829-a0ab41605b3d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:28.203408 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e48120f8-0720-4d30-a829-a0ab41605b3d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:28.217638 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e48120f8-0720-4d30-a829-a0ab41605b3d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:28.218818 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e48120f8-0720-4d30-a829-a0ab41605b3d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:28.219702 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e48120f8-0720-4d30-a829-a0ab41605b3d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:28.221013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e48120f8-0720-4d30-a829-a0ab41605b3d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:28.221863 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e48120f8-0720-4d30-a829-a0ab41605b3d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:28.222410 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e48120f8-0720-4d30-a829-a0ab41605b3d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:28.450940 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e48120f8-0720-4d30-a829-a0ab41605b3d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:28.459843 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-80113292-ef06-4eb2-8630-661a154ec80e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:28.460898 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-80113292-ef06-4eb2-8630-661a154ec80e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:28.461663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e48120f8-0720-4d30-a829-a0ab41605b3d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:28.463282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e48120f8-0720-4d30-a829-a0ab41605b3d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:28.464615 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e48120f8-0720-4d30-a829-a0ab41605b3d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.279210 Aug 22 17:27:28.465324 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 52/114] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:28 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:28.471076 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-80113292-ef06-4eb2-8630-661a154ec80e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:28.474844 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-80113292-ef06-4eb2-8630-661a154ec80e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:28.474844 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-80113292-ef06-4eb2-8630-661a154ec80e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:28.474844 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-80113292-ef06-4eb2-8630-661a154ec80e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:28.475619 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-80113292-ef06-4eb2-8630-661a154ec80e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:28.476750 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-80113292-ef06-4eb2-8630-661a154ec80e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:28.749271 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-80113292-ef06-4eb2-8630-661a154ec80e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:28.787370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-80113292-ef06-4eb2-8630-661a154ec80e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.332397 Aug 22 17:27:28.811391 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 63/115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:28 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:28.933687 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-52567976-2801-4c70-9a5f-143fe7ebd702 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:28.939012 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-52567976-2801-4c70-9a5f-143fe7ebd702 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:28.976974 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:28.981340 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52567976-2801-4c70-9a5f-143fe7ebd702 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:28.982152 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52567976-2801-4c70-9a5f-143fe7ebd702 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:28.986841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52567976-2801-4c70-9a5f-143fe7ebd702 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:29.000330 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52567976-2801-4c70-9a5f-143fe7ebd702 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:29.006773 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52567976-2801-4c70-9a5f-143fe7ebd702 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:29.006773 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52567976-2801-4c70-9a5f-143fe7ebd702 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:29.190626 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2f06dcaa-1895-408d-ba96-855ca0bce825 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:29.194602 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-2f06dcaa-1895-408d-ba96-855ca0bce825 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:29.228635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2f06dcaa-1895-408d-ba96-855ca0bce825 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:29.231406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2f06dcaa-1895-408d-ba96-855ca0bce825 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:29.233921 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2f06dcaa-1895-408d-ba96-855ca0bce825 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:29.238147 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2f06dcaa-1895-408d-ba96-855ca0bce825 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:29.239324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2f06dcaa-1895-408d-ba96-855ca0bce825 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:29.242762 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2f06dcaa-1895-408d-ba96-855ca0bce825 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:29.257236 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-52567976-2801-4c70-9a5f-143fe7ebd702 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:29.269471 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-52567976-2801-4c70-9a5f-143fe7ebd702 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.345841 Aug 22 17:27:29.271334 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 53/116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:28 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:29.502407 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2f06dcaa-1895-408d-ba96-855ca0bce825 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:29.504094 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-60b55eaa-62d2-40ed-ad56-f496ee0834f2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:29.505910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-60b55eaa-62d2-40ed-ad56-f496ee0834f2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:29.517000 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-60b55eaa-62d2-40ed-ad56-f496ee0834f2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:29.522521 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2f06dcaa-1895-408d-ba96-855ca0bce825 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.334012 Aug 22 17:27:29.522750 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-60b55eaa-62d2-40ed-ad56-f496ee0834f2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:29.522894 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 64/117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:29 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:29.523045 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-60b55eaa-62d2-40ed-ad56-f496ee0834f2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:29.523045 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-60b55eaa-62d2-40ed-ad56-f496ee0834f2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:29.523045 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-60b55eaa-62d2-40ed-ad56-f496ee0834f2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:29.523045 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-60b55eaa-62d2-40ed-ad56-f496ee0834f2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:29.746341 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-60b55eaa-62d2-40ed-ad56-f496ee0834f2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:29.772229 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-60b55eaa-62d2-40ed-ad56-f496ee0834f2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:29.778038 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-60b55eaa-62d2-40ed-ad56-f496ee0834f2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:29.783912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-60b55eaa-62d2-40ed-ad56-f496ee0834f2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.286649 Aug 22 17:27:29.785132 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 54/118] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:29 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:29.826840 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-912aa18d-a03b-4693-81d6-221e92e93088 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:29.827734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-912aa18d-a03b-4693-81d6-221e92e93088 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:29.843025 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-912aa18d-a03b-4693-81d6-221e92e93088 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:29.843025 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-912aa18d-a03b-4693-81d6-221e92e93088 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:29.843025 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-912aa18d-a03b-4693-81d6-221e92e93088 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:29.843025 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-912aa18d-a03b-4693-81d6-221e92e93088 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:29.843824 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-912aa18d-a03b-4693-81d6-221e92e93088 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:29.843824 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-912aa18d-a03b-4693-81d6-221e92e93088 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:30.015901 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-912aa18d-a03b-4693-81d6-221e92e93088 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:30.030204 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-912aa18d-a03b-4693-81d6-221e92e93088 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.207757 Aug 22 17:27:30.031952 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 65/119] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:29 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:30.309878 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d75d2b7b-ec66-4d3a-9752-8ae381f63829 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:30.311076 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d75d2b7b-ec66-4d3a-9752-8ae381f63829 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:30.316281 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=91 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:30.324019 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d75d2b7b-ec66-4d3a-9752-8ae381f63829 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:30.324901 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d75d2b7b-ec66-4d3a-9752-8ae381f63829 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:30.325889 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d75d2b7b-ec66-4d3a-9752-8ae381f63829 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:30.327208 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d75d2b7b-ec66-4d3a-9752-8ae381f63829 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:30.328032 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d75d2b7b-ec66-4d3a-9752-8ae381f63829 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:30.328820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d75d2b7b-ec66-4d3a-9752-8ae381f63829 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:30.541395 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d8ce9a6b-d8d4-477d-b3e6-49225ee559fc tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:30.542215 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d8ce9a6b-d8d4-477d-b3e6-49225ee559fc tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:30.558291 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d8ce9a6b-d8d4-477d-b3e6-49225ee559fc tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:30.562532 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d8ce9a6b-d8d4-477d-b3e6-49225ee559fc tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:30.562532 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d8ce9a6b-d8d4-477d-b3e6-49225ee559fc tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:30.562532 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d8ce9a6b-d8d4-477d-b3e6-49225ee559fc tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:30.562532 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d8ce9a6b-d8d4-477d-b3e6-49225ee559fc tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:30.563124 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d8ce9a6b-d8d4-477d-b3e6-49225ee559fc tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:30.815843 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d75d2b7b-ec66-4d3a-9752-8ae381f63829 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:30.829454 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d75d2b7b-ec66-4d3a-9752-8ae381f63829 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.527463 Aug 22 17:27:30.830156 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 55/120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:30 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:30.843522 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-7b86c704-0efe-4ffd-b246-4a143ff3df36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:30.861911 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-d8ce9a6b-d8d4-477d-b3e6-49225ee559fc tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:30.863777 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-7b86c704-0efe-4ffd-b246-4a143ff3df36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:30.883178 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7b86c704-0efe-4ffd-b246-4a143ff3df36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:30.883685 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7b86c704-0efe-4ffd-b246-4a143ff3df36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:30.884127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7b86c704-0efe-4ffd-b246-4a143ff3df36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:30.884853 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7b86c704-0efe-4ffd-b246-4a143ff3df36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:30.885303 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7b86c704-0efe-4ffd-b246-4a143ff3df36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:30.887925 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7b86c704-0efe-4ffd-b246-4a143ff3df36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:30.898256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d8ce9a6b-d8d4-477d-b3e6-49225ee559fc tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.350948 Aug 22 17:27:30.909454 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 66/121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:30 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:31.067410 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-67bf18a7-05c5-4efb-94b4-c58f82264e39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:31.073779 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-67bf18a7-05c5-4efb-94b4-c58f82264e39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:31.101926 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-67bf18a7-05c5-4efb-94b4-c58f82264e39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:31.104072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-67bf18a7-05c5-4efb-94b4-c58f82264e39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:31.105307 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-67bf18a7-05c5-4efb-94b4-c58f82264e39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:31.109421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-67bf18a7-05c5-4efb-94b4-c58f82264e39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:31.124268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-67bf18a7-05c5-4efb-94b4-c58f82264e39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:31.127770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-67bf18a7-05c5-4efb-94b4-c58f82264e39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:31.634389 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-67bf18a7-05c5-4efb-94b4-c58f82264e39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:31.643435 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-67bf18a7-05c5-4efb-94b4-c58f82264e39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.583190 Aug 22 17:27:31.657414 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 67/122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:31 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:31.749515 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7b86c704-0efe-4ffd-b246-4a143ff3df36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:31.764907 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7b86c704-0efe-4ffd-b246-4a143ff3df36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:31.767031 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7b86c704-0efe-4ffd-b246-4a143ff3df36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:31.769541 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-7b86c704-0efe-4ffd-b246-4a143ff3df36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.936042 Aug 22 17:27:31.770383 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 56/123] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:30 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:31.872398 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b0f3cce5-a4a7-49b2-aca0-3903eacc7499 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:31.874009 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b0f3cce5-a4a7-49b2-aca0-3903eacc7499 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:31.884770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b0f3cce5-a4a7-49b2-aca0-3903eacc7499 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:31.885589 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b0f3cce5-a4a7-49b2-aca0-3903eacc7499 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:31.886311 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b0f3cce5-a4a7-49b2-aca0-3903eacc7499 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:31.887812 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b0f3cce5-a4a7-49b2-aca0-3903eacc7499 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:31.888902 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b0f3cce5-a4a7-49b2-aca0-3903eacc7499 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:31.889841 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b0f3cce5-a4a7-49b2-aca0-3903eacc7499 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:31.965563 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5211582c-ab5e-4c3d-9b56-c6d5803f673d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:31.966425 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5211582c-ab5e-4c3d-9b56-c6d5803f673d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:31.973905 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5211582c-ab5e-4c3d-9b56-c6d5803f673d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:31.974981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5211582c-ab5e-4c3d-9b56-c6d5803f673d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:31.983026 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5211582c-ab5e-4c3d-9b56-c6d5803f673d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:31.983026 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5211582c-ab5e-4c3d-9b56-c6d5803f673d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:31.983026 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5211582c-ab5e-4c3d-9b56-c6d5803f673d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:31.983026 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5211582c-ab5e-4c3d-9b56-c6d5803f673d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:32.128723 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b0f3cce5-a4a7-49b2-aca0-3903eacc7499 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:32.148759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b0f3cce5-a4a7-49b2-aca0-3903eacc7499 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.283596 Aug 22 17:27:32.151141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 68/124] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:31 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:32.184538 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5211582c-ab5e-4c3d-9b56-c6d5803f673d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:32.193262 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5211582c-ab5e-4c3d-9b56-c6d5803f673d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.233667 Aug 22 17:27:32.194100 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 57/125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:31 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:32.669739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f562e036-c51f-4f8b-8957-312fcf109f14 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:32.670858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f562e036-c51f-4f8b-8957-312fcf109f14 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:32.683258 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f562e036-c51f-4f8b-8957-312fcf109f14 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:32.684344 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f562e036-c51f-4f8b-8957-312fcf109f14 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:32.685155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f562e036-c51f-4f8b-8957-312fcf109f14 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:32.686710 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f562e036-c51f-4f8b-8957-312fcf109f14 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:32.687596 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f562e036-c51f-4f8b-8957-312fcf109f14 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:32.688370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f562e036-c51f-4f8b-8957-312fcf109f14 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:32.806164 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a29ac197-5f1e-4a9e-97b8-02372d3f50fb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:32.807229 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a29ac197-5f1e-4a9e-97b8-02372d3f50fb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:32.818319 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a29ac197-5f1e-4a9e-97b8-02372d3f50fb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:32.825104 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a29ac197-5f1e-4a9e-97b8-02372d3f50fb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:32.825104 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a29ac197-5f1e-4a9e-97b8-02372d3f50fb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:32.825104 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a29ac197-5f1e-4a9e-97b8-02372d3f50fb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:32.825104 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a29ac197-5f1e-4a9e-97b8-02372d3f50fb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:32.825696 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a29ac197-5f1e-4a9e-97b8-02372d3f50fb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:32.893811 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f562e036-c51f-4f8b-8957-312fcf109f14 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:32.902963 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f562e036-c51f-4f8b-8957-312fcf109f14 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.242093 Aug 22 17:27:32.917185 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 69/126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:32 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:33.003011 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a29ac197-5f1e-4a9e-97b8-02372d3f50fb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:33.011724 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a29ac197-5f1e-4a9e-97b8-02372d3f50fb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:33.013358 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a29ac197-5f1e-4a9e-97b8-02372d3f50fb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:33.014871 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a29ac197-5f1e-4a9e-97b8-02372d3f50fb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.216254 Aug 22 17:27:33.015443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 58/127] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:32 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:33.185078 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-04d7f00e-0cfe-41dd-b7d9-d669a1158df0 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:33.185700 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-04d7f00e-0cfe-41dd-b7d9-d669a1158df0 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:33.192246 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-04d7f00e-0cfe-41dd-b7d9-d669a1158df0 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:33.193070 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-04d7f00e-0cfe-41dd-b7d9-d669a1158df0 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:33.193667 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-04d7f00e-0cfe-41dd-b7d9-d669a1158df0 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:33.194642 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-04d7f00e-0cfe-41dd-b7d9-d669a1158df0 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:33.195101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-04d7f00e-0cfe-41dd-b7d9-d669a1158df0 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:33.195684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-04d7f00e-0cfe-41dd-b7d9-d669a1158df0 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:33.215330 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c22805d9-abdf-418b-9809-bb1677b30057 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:33.216945 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c22805d9-abdf-418b-9809-bb1677b30057 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:33.227480 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c22805d9-abdf-418b-9809-bb1677b30057 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:33.227972 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c22805d9-abdf-418b-9809-bb1677b30057 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:33.231898 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c22805d9-abdf-418b-9809-bb1677b30057 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:33.232904 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c22805d9-abdf-418b-9809-bb1677b30057 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:33.233392 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c22805d9-abdf-418b-9809-bb1677b30057 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:33.233820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c22805d9-abdf-418b-9809-bb1677b30057 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:33.411403 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-04d7f00e-0cfe-41dd-b7d9-d669a1158df0 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:33.421360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-04d7f00e-0cfe-41dd-b7d9-d669a1158df0 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.239832 Aug 22 17:27:33.422527 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 70/128] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:33 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:33.477812 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c22805d9-abdf-418b-9809-bb1677b30057 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:33.500420 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c22805d9-abdf-418b-9809-bb1677b30057 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.288783 Aug 22 17:27:33.501145 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 59/129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:33 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:33.925068 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b88e5877-7c9d-4fd3-9a21-ab15f04ecaa5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:33.925829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b88e5877-7c9d-4fd3-9a21-ab15f04ecaa5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:33.934809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b88e5877-7c9d-4fd3-9a21-ab15f04ecaa5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:33.935411 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b88e5877-7c9d-4fd3-9a21-ab15f04ecaa5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:33.935935 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b88e5877-7c9d-4fd3-9a21-ab15f04ecaa5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:33.936722 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b88e5877-7c9d-4fd3-9a21-ab15f04ecaa5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:33.937302 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b88e5877-7c9d-4fd3-9a21-ab15f04ecaa5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:33.937865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b88e5877-7c9d-4fd3-9a21-ab15f04ecaa5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:34.046976 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c5464233-c9c8-4171-9b29-0e604378d6d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:34.049026 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c5464233-c9c8-4171-9b29-0e604378d6d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:34.080473 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c5464233-c9c8-4171-9b29-0e604378d6d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:34.082148 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c5464233-c9c8-4171-9b29-0e604378d6d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:34.082927 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c5464233-c9c8-4171-9b29-0e604378d6d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:34.084785 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c5464233-c9c8-4171-9b29-0e604378d6d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:34.085681 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c5464233-c9c8-4171-9b29-0e604378d6d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:34.086430 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c5464233-c9c8-4171-9b29-0e604378d6d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:34.171903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b88e5877-7c9d-4fd3-9a21-ab15f04ecaa5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:34.183869 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b88e5877-7c9d-4fd3-9a21-ab15f04ecaa5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.263144 Aug 22 17:27:34.185457 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 71/130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:33 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:34.258243 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c5464233-c9c8-4171-9b29-0e604378d6d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:34.269608 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c5464233-c9c8-4171-9b29-0e604378d6d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:34.271759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c5464233-c9c8-4171-9b29-0e604378d6d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:34.272415 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c5464233-c9c8-4171-9b29-0e604378d6d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.233249 Aug 22 17:27:34.272979 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 60/131] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:34 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:27:34.454521 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-02397582-6719-423f-8a09-e67085f49189 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:34.455401 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-02397582-6719-423f-8a09-e67085f49189 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:34.472635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-02397582-6719-423f-8a09-e67085f49189 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:34.473581 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-02397582-6719-423f-8a09-e67085f49189 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:34.475524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-02397582-6719-423f-8a09-e67085f49189 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:34.476576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-02397582-6719-423f-8a09-e67085f49189 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:34.477713 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-02397582-6719-423f-8a09-e67085f49189 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:34.478740 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-02397582-6719-423f-8a09-e67085f49189 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:34.484810 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=100 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:34.532261 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-febb8b2f-31f1-46e4-80fe-d5c8e61d1ee6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:34.535690 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-febb8b2f-31f1-46e4-80fe-d5c8e61d1ee6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:34.557652 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-febb8b2f-31f1-46e4-80fe-d5c8e61d1ee6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:34.558532 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-febb8b2f-31f1-46e4-80fe-d5c8e61d1ee6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:34.559595 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-febb8b2f-31f1-46e4-80fe-d5c8e61d1ee6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:34.561012 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-febb8b2f-31f1-46e4-80fe-d5c8e61d1ee6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:34.561855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-febb8b2f-31f1-46e4-80fe-d5c8e61d1ee6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:34.562643 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-febb8b2f-31f1-46e4-80fe-d5c8e61d1ee6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:34.697884 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-02397582-6719-423f-8a09-e67085f49189 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:34.707205 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-02397582-6719-423f-8a09-e67085f49189 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.256992 Aug 22 17:27:34.707801 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 72/132] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:34 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:34.772446 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-febb8b2f-31f1-46e4-80fe-d5c8e61d1ee6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:34.783154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-febb8b2f-31f1-46e4-80fe-d5c8e61d1ee6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.264283 Aug 22 17:27:34.783958 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 61/133] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:34 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:35.216937 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5795c61a-e7ee-4e0f-b89f-4c0262bdbc52 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:35.217753 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5795c61a-e7ee-4e0f-b89f-4c0262bdbc52 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:35.225359 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5795c61a-e7ee-4e0f-b89f-4c0262bdbc52 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:35.225858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5795c61a-e7ee-4e0f-b89f-4c0262bdbc52 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:35.226286 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5795c61a-e7ee-4e0f-b89f-4c0262bdbc52 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:35.229848 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5795c61a-e7ee-4e0f-b89f-4c0262bdbc52 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:35.229848 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5795c61a-e7ee-4e0f-b89f-4c0262bdbc52 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:35.229848 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5795c61a-e7ee-4e0f-b89f-4c0262bdbc52 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:35.307278 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5632ac4c-aeb2-4490-a27b-77b7dc51c05a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:35.308962 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5632ac4c-aeb2-4490-a27b-77b7dc51c05a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:35.323299 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5632ac4c-aeb2-4490-a27b-77b7dc51c05a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:35.324244 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5632ac4c-aeb2-4490-a27b-77b7dc51c05a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:35.325013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5632ac4c-aeb2-4490-a27b-77b7dc51c05a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:35.326339 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5632ac4c-aeb2-4490-a27b-77b7dc51c05a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:35.327197 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5632ac4c-aeb2-4490-a27b-77b7dc51c05a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:35.327872 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5632ac4c-aeb2-4490-a27b-77b7dc51c05a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:35.387255 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5795c61a-e7ee-4e0f-b89f-4c0262bdbc52 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:35.400919 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5795c61a-e7ee-4e0f-b89f-4c0262bdbc52 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.187790 Aug 22 17:27:35.401688 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 73/134] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:35 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:35.588079 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5632ac4c-aeb2-4490-a27b-77b7dc51c05a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:35.604688 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5632ac4c-aeb2-4490-a27b-77b7dc51c05a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:35.608222 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5632ac4c-aeb2-4490-a27b-77b7dc51c05a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:35.610520 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5632ac4c-aeb2-4490-a27b-77b7dc51c05a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.316916 Aug 22 17:27:35.611723 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 62/135] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:35 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:35.743193 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-042f20aa-ce81-45f3-b6e3-456f326f6e61 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:35.743863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-042f20aa-ce81-45f3-b6e3-456f326f6e61 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:35.750879 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-042f20aa-ce81-45f3-b6e3-456f326f6e61 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:35.751373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-042f20aa-ce81-45f3-b6e3-456f326f6e61 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:35.751810 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-042f20aa-ce81-45f3-b6e3-456f326f6e61 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:35.752549 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-042f20aa-ce81-45f3-b6e3-456f326f6e61 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:35.753100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-042f20aa-ce81-45f3-b6e3-456f326f6e61 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:35.753607 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-042f20aa-ce81-45f3-b6e3-456f326f6e61 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:35.823184 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0d8aff4b-d744-4154-a25d-6e578f91d852 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:35.824466 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0d8aff4b-d744-4154-a25d-6e578f91d852 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:35.835470 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0d8aff4b-d744-4154-a25d-6e578f91d852 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:35.836438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0d8aff4b-d744-4154-a25d-6e578f91d852 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:35.837245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0d8aff4b-d744-4154-a25d-6e578f91d852 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:35.838456 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0d8aff4b-d744-4154-a25d-6e578f91d852 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:35.839263 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0d8aff4b-d744-4154-a25d-6e578f91d852 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:35.840070 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0d8aff4b-d744-4154-a25d-6e578f91d852 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:35.940468 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-042f20aa-ce81-45f3-b6e3-456f326f6e61 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:35.950494 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-042f20aa-ce81-45f3-b6e3-456f326f6e61 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.212601 Aug 22 17:27:35.951132 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 74/136] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:35 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:36.070618 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0d8aff4b-d744-4154-a25d-6e578f91d852 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:36.074762 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=100 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:36.084995 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0d8aff4b-d744-4154-a25d-6e578f91d852 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.267701 Aug 22 17:27:36.086396 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 63/137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:35 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:36.432317 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-1cb31cec-f475-47d1-87f0-594aa5b2e51e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:36.433547 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-1cb31cec-f475-47d1-87f0-594aa5b2e51e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:36.443960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1cb31cec-f475-47d1-87f0-594aa5b2e51e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:36.444943 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1cb31cec-f475-47d1-87f0-594aa5b2e51e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:36.446177 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1cb31cec-f475-47d1-87f0-594aa5b2e51e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:36.447196 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1cb31cec-f475-47d1-87f0-594aa5b2e51e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:36.447965 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1cb31cec-f475-47d1-87f0-594aa5b2e51e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:36.449243 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1cb31cec-f475-47d1-87f0-594aa5b2e51e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:36.649537 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-55832568-dfa4-4c7b-bc17-9bdd1a603b19 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:36.650291 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-55832568-dfa4-4c7b-bc17-9bdd1a603b19 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:36.663787 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55832568-dfa4-4c7b-bc17-9bdd1a603b19 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:36.664294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55832568-dfa4-4c7b-bc17-9bdd1a603b19 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:36.664730 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55832568-dfa4-4c7b-bc17-9bdd1a603b19 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:36.665510 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55832568-dfa4-4c7b-bc17-9bdd1a603b19 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:36.665963 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55832568-dfa4-4c7b-bc17-9bdd1a603b19 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:36.666380 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55832568-dfa4-4c7b-bc17-9bdd1a603b19 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:36.807268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-1cb31cec-f475-47d1-87f0-594aa5b2e51e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:36.821445 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-1cb31cec-f475-47d1-87f0-594aa5b2e51e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.395442 Aug 22 17:27:36.822056 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 75/138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:36 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:36.994407 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a2c86472-c80b-4b00-b890-96b7830c9218 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:36.999717 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a2c86472-c80b-4b00-b890-96b7830c9218 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:37.042889 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a2c86472-c80b-4b00-b890-96b7830c9218 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:37.044324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a2c86472-c80b-4b00-b890-96b7830c9218 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:37.045342 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a2c86472-c80b-4b00-b890-96b7830c9218 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:37.047027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a2c86472-c80b-4b00-b890-96b7830c9218 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:37.048709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a2c86472-c80b-4b00-b890-96b7830c9218 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:37.049681 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a2c86472-c80b-4b00-b890-96b7830c9218 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:37.130585 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-55832568-dfa4-4c7b-bc17-9bdd1a603b19 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:37.149064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-55832568-dfa4-4c7b-bc17-9bdd1a603b19 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:37.150886 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-55832568-dfa4-4c7b-bc17-9bdd1a603b19 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:37.152065 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-55832568-dfa4-4c7b-bc17-9bdd1a603b19 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.507327 Aug 22 17:27:37.154253 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 64/139] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:36 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:27:37.159222 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-7b94205d-9d99-4708-8721-20ef013bea00 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:37.165022 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-7b94205d-9d99-4708-8721-20ef013bea00 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:37.191435 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7b94205d-9d99-4708-8721-20ef013bea00 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:37.196298 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7b94205d-9d99-4708-8721-20ef013bea00 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:37.197849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7b94205d-9d99-4708-8721-20ef013bea00 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:37.199793 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7b94205d-9d99-4708-8721-20ef013bea00 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:37.200828 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7b94205d-9d99-4708-8721-20ef013bea00 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:37.204127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7b94205d-9d99-4708-8721-20ef013bea00 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:37.428946 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7b94205d-9d99-4708-8721-20ef013bea00 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:37.442086 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-7b94205d-9d99-4708-8721-20ef013bea00 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.286339 Aug 22 17:27:37.443436 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 65/140] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:37 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:37.830228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a2c86472-c80b-4b00-b890-96b7830c9218 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:37.842359 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a2c86472-c80b-4b00-b890-96b7830c9218 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.855802 Aug 22 17:27:37.843855 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 76/141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:36 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:37.875138 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c987547a-27a2-414d-9603-16893bcb47b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:37.876888 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c987547a-27a2-414d-9603-16893bcb47b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:37.886798 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c987547a-27a2-414d-9603-16893bcb47b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:37.887945 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c987547a-27a2-414d-9603-16893bcb47b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:37.888943 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c987547a-27a2-414d-9603-16893bcb47b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:37.890695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c987547a-27a2-414d-9603-16893bcb47b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:37.891925 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c987547a-27a2-414d-9603-16893bcb47b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:37.893158 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c987547a-27a2-414d-9603-16893bcb47b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:38.118925 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c987547a-27a2-414d-9603-16893bcb47b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:38.144592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c987547a-27a2-414d-9603-16893bcb47b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.290307 Aug 22 17:27:38.154289 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 66/142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:37 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:38.214034 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-223a7cf0-5d2e-4f82-bdea-1f99bf499d9a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:38.215292 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-223a7cf0-5d2e-4f82-bdea-1f99bf499d9a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:38.227254 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-223a7cf0-5d2e-4f82-bdea-1f99bf499d9a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:38.228185 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-223a7cf0-5d2e-4f82-bdea-1f99bf499d9a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:38.229162 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-223a7cf0-5d2e-4f82-bdea-1f99bf499d9a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:38.230635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-223a7cf0-5d2e-4f82-bdea-1f99bf499d9a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:38.231567 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-223a7cf0-5d2e-4f82-bdea-1f99bf499d9a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:38.232351 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-223a7cf0-5d2e-4f82-bdea-1f99bf499d9a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:38.469672 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4d88018b-10c5-4f1a-a364-f6eaddea0232 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:38.470880 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4d88018b-10c5-4f1a-a364-f6eaddea0232 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:38.484617 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d88018b-10c5-4f1a-a364-f6eaddea0232 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:38.485893 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d88018b-10c5-4f1a-a364-f6eaddea0232 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:38.487869 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d88018b-10c5-4f1a-a364-f6eaddea0232 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:38.488418 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d88018b-10c5-4f1a-a364-f6eaddea0232 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:38.489891 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d88018b-10c5-4f1a-a364-f6eaddea0232 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:38.490134 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-223a7cf0-5d2e-4f82-bdea-1f99bf499d9a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:38.491142 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d88018b-10c5-4f1a-a364-f6eaddea0232 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:38.513106 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-223a7cf0-5d2e-4f82-bdea-1f99bf499d9a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:38.516408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-223a7cf0-5d2e-4f82-bdea-1f99bf499d9a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:38.518557 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-223a7cf0-5d2e-4f82-bdea-1f99bf499d9a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.312813 Aug 22 17:27:38.521802 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 77/143] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:38 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:38.781925 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4d88018b-10c5-4f1a-a364-f6eaddea0232 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:38.806519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4d88018b-10c5-4f1a-a364-f6eaddea0232 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.342015 Aug 22 17:27:38.808076 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 67/144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:38 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:38.888483 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-3be33bc2-ab60-417e-9f71-1440d5d850e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:38.889722 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-3be33bc2-ab60-417e-9f71-1440d5d850e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:38.918869 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3be33bc2-ab60-417e-9f71-1440d5d850e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:38.920095 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3be33bc2-ab60-417e-9f71-1440d5d850e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:38.921404 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3be33bc2-ab60-417e-9f71-1440d5d850e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:38.922768 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3be33bc2-ab60-417e-9f71-1440d5d850e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:38.923623 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3be33bc2-ab60-417e-9f71-1440d5d850e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:38.924263 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3be33bc2-ab60-417e-9f71-1440d5d850e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:39.001830 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-13a841ff-5d95-48f8-846c-fa0f34741cb6 req-1cbf52be-a2a6-48e5-b4e6-3232bcbc1d3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb123a58-2326-45c2-8c47-e297dd1d60c2", "name": "network-vif-plugged", "status": "completed", "tag": "d2251451-3cf4-4bc2-94f0-b88d3e3158ae"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:27:39.031970 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-13a841ff-5d95-48f8-846c-fa0f34741cb6 req-1cbf52be-a2a6-48e5-b4e6-3232bcbc1d3c service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:39.032802 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-13a841ff-5d95-48f8-846c-fa0f34741cb6 req-1cbf52be-a2a6-48e5-b4e6-3232bcbc1d3c service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:39.046456 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-13a841ff-5d95-48f8-846c-fa0f34741cb6 req-1cbf52be-a2a6-48e5-b4e6-3232bcbc1d3c service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:39.085231 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-13a841ff-5d95-48f8-846c-fa0f34741cb6 req-1cbf52be-a2a6-48e5-b4e6-3232bcbc1d3c service nova] Creating event network-vif-plugged:d2251451-3cf4-4bc2-94f0-b88d3e3158ae for instance eb123a58-2326-45c2-8c47-e297dd1d60c2 on hv-cinder-85394 Aug 22 17:27:39.100809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-13a841ff-5d95-48f8-846c-fa0f34741cb6 req-1cbf52be-a2a6-48e5-b4e6-3232bcbc1d3c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.400222 Aug 22 17:27:39.102111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 78/145] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:27:39.188870 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-db4484ea-b492-4b89-8ab9-af4506d71ae6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:39.190726 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-db4484ea-b492-4b89-8ab9-af4506d71ae6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:39.202981 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-db4484ea-b492-4b89-8ab9-af4506d71ae6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:39.204163 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-db4484ea-b492-4b89-8ab9-af4506d71ae6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:39.205156 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-db4484ea-b492-4b89-8ab9-af4506d71ae6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:39.207029 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-db4484ea-b492-4b89-8ab9-af4506d71ae6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:39.208579 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-db4484ea-b492-4b89-8ab9-af4506d71ae6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:39.210800 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-db4484ea-b492-4b89-8ab9-af4506d71ae6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:39.293436 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-3be33bc2-ab60-417e-9f71-1440d5d850e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:39.314451 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-3be33bc2-ab60-417e-9f71-1440d5d850e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.434239 Aug 22 17:27:39.329244 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 68/146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:38 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:39.549724 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-db4484ea-b492-4b89-8ab9-af4506d71ae6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:39.561910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-24939613-f369-44fe-b8e1-2fc7e938f8c1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:39.564315 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-24939613-f369-44fe-b8e1-2fc7e938f8c1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:39.578370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-db4484ea-b492-4b89-8ab9-af4506d71ae6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.394229 Aug 22 17:27:39.579710 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 79/147] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:39 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:39.603919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-24939613-f369-44fe-b8e1-2fc7e938f8c1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:39.604440 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-24939613-f369-44fe-b8e1-2fc7e938f8c1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:39.604894 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-24939613-f369-44fe-b8e1-2fc7e938f8c1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:39.606149 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-24939613-f369-44fe-b8e1-2fc7e938f8c1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:39.611935 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-24939613-f369-44fe-b8e1-2fc7e938f8c1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:39.614205 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-24939613-f369-44fe-b8e1-2fc7e938f8c1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:39.838858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6bb6d34c-6ea9-4ca2-8cfe-5e20d266c4b2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:39.839068 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-24939613-f369-44fe-b8e1-2fc7e938f8c1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:39.840018 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6bb6d34c-6ea9-4ca2-8cfe-5e20d266c4b2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:39.848430 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6bb6d34c-6ea9-4ca2-8cfe-5e20d266c4b2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:39.850261 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6bb6d34c-6ea9-4ca2-8cfe-5e20d266c4b2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:39.856090 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6bb6d34c-6ea9-4ca2-8cfe-5e20d266c4b2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:39.856090 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6bb6d34c-6ea9-4ca2-8cfe-5e20d266c4b2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:39.856090 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6bb6d34c-6ea9-4ca2-8cfe-5e20d266c4b2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:39.856090 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6bb6d34c-6ea9-4ca2-8cfe-5e20d266c4b2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:39.866571 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-24939613-f369-44fe-b8e1-2fc7e938f8c1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:39.873504 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-24939613-f369-44fe-b8e1-2fc7e938f8c1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:39.876702 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-24939613-f369-44fe-b8e1-2fc7e938f8c1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.323977 Aug 22 17:27:39.878604 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 69/148] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:39 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:40.112876 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6bb6d34c-6ea9-4ca2-8cfe-5e20d266c4b2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:40.129166 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6bb6d34c-6ea9-4ca2-8cfe-5e20d266c4b2 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.294116 Aug 22 17:27:40.130831 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 80/149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:39 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:40.340401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0cddd6e0-e6c9-4313-9e0d-80a0db29e3b7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:40.341159 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0cddd6e0-e6c9-4313-9e0d-80a0db29e3b7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:40.352110 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0cddd6e0-e6c9-4313-9e0d-80a0db29e3b7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:40.352971 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0cddd6e0-e6c9-4313-9e0d-80a0db29e3b7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:40.353835 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0cddd6e0-e6c9-4313-9e0d-80a0db29e3b7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:40.356408 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0cddd6e0-e6c9-4313-9e0d-80a0db29e3b7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:40.357081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0cddd6e0-e6c9-4313-9e0d-80a0db29e3b7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:40.357609 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0cddd6e0-e6c9-4313-9e0d-80a0db29e3b7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:40.499277 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0cddd6e0-e6c9-4313-9e0d-80a0db29e3b7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:40.507333 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0cddd6e0-e6c9-4313-9e0d-80a0db29e3b7 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.172305 Aug 22 17:27:40.507922 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 70/150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:40 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:40.616685 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ff269ec0-403c-40dc-b19d-3341adb20555 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:40.617377 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ff269ec0-403c-40dc-b19d-3341adb20555 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:40.624129 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff269ec0-403c-40dc-b19d-3341adb20555 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:40.624897 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff269ec0-403c-40dc-b19d-3341adb20555 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:40.626055 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff269ec0-403c-40dc-b19d-3341adb20555 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:40.626825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff269ec0-403c-40dc-b19d-3341adb20555 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:40.627297 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff269ec0-403c-40dc-b19d-3341adb20555 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:40.627720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff269ec0-403c-40dc-b19d-3341adb20555 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:40.804965 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ff269ec0-403c-40dc-b19d-3341adb20555 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:40.817833 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ff269ec0-403c-40dc-b19d-3341adb20555 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.205575 Aug 22 17:27:40.820035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 81/151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:40 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:40.922702 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a526e07e-cc16-4c6a-ac49-3cd0794127d9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:40.923899 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a526e07e-cc16-4c6a-ac49-3cd0794127d9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:40.931826 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a526e07e-cc16-4c6a-ac49-3cd0794127d9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:40.934217 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a526e07e-cc16-4c6a-ac49-3cd0794127d9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:40.934217 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a526e07e-cc16-4c6a-ac49-3cd0794127d9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:40.934217 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a526e07e-cc16-4c6a-ac49-3cd0794127d9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:40.934217 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a526e07e-cc16-4c6a-ac49-3cd0794127d9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:40.934731 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a526e07e-cc16-4c6a-ac49-3cd0794127d9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:41.131687 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a526e07e-cc16-4c6a-ac49-3cd0794127d9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:41.137324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-9819afd4-ed97-4d16-bc94-2d3137bf3cdb req-651611d2-aec3-48b3-b2f1-4dc0cf304311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66262c8d-0245-4a3f-83e8-d3093c6d1057", "name": "network-vif-plugged", "status": "completed", "tag": "162afc48-12ea-4a69-b48b-a1d677b0c796"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:27:41.147928 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a526e07e-cc16-4c6a-ac49-3cd0794127d9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:41.151107 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a526e07e-cc16-4c6a-ac49-3cd0794127d9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:41.153236 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a526e07e-cc16-4c6a-ac49-3cd0794127d9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.238368 Aug 22 17:27:41.154416 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 71/152] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:40 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:41.160761 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-77a5afff-bdc7-45de-97cf-411800bb3087 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:41.162141 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-77a5afff-bdc7-45de-97cf-411800bb3087 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:41.167980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9819afd4-ed97-4d16-bc94-2d3137bf3cdb req-651611d2-aec3-48b3-b2f1-4dc0cf304311 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:41.171131 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-77a5afff-bdc7-45de-97cf-411800bb3087 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:41.171742 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-77a5afff-bdc7-45de-97cf-411800bb3087 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:41.172254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-77a5afff-bdc7-45de-97cf-411800bb3087 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:41.172461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9819afd4-ed97-4d16-bc94-2d3137bf3cdb req-651611d2-aec3-48b3-b2f1-4dc0cf304311 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:41.173069 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-77a5afff-bdc7-45de-97cf-411800bb3087 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:41.173248 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9819afd4-ed97-4d16-bc94-2d3137bf3cdb req-651611d2-aec3-48b3-b2f1-4dc0cf304311 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:41.173626 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-77a5afff-bdc7-45de-97cf-411800bb3087 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:41.174121 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-77a5afff-bdc7-45de-97cf-411800bb3087 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:41.197269 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-9819afd4-ed97-4d16-bc94-2d3137bf3cdb req-651611d2-aec3-48b3-b2f1-4dc0cf304311 service nova] Creating event network-vif-plugged:162afc48-12ea-4a69-b48b-a1d677b0c796 for instance 66262c8d-0245-4a3f-83e8-d3093c6d1057 on hv-cinder-85394 Aug 22 17:27:41.207068 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-9819afd4-ed97-4d16-bc94-2d3137bf3cdb req-651611d2-aec3-48b3-b2f1-4dc0cf304311 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083505 Aug 22 17:27:41.221798 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 82/153] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:27:41.438748 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-77a5afff-bdc7-45de-97cf-411800bb3087 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:41.438748 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-77a5afff-bdc7-45de-97cf-411800bb3087 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.214715 Aug 22 17:27:41.438748 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 72/154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:41 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:41.531050 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a795eebf-2608-40de-bdd0-890424258440 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:41.532013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a795eebf-2608-40de-bdd0-890424258440 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:41.538687 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a795eebf-2608-40de-bdd0-890424258440 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:41.539202 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a795eebf-2608-40de-bdd0-890424258440 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:41.552518 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a795eebf-2608-40de-bdd0-890424258440 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:41.552518 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a795eebf-2608-40de-bdd0-890424258440 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:41.552518 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a795eebf-2608-40de-bdd0-890424258440 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:41.552518 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a795eebf-2608-40de-bdd0-890424258440 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:41.699928 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a795eebf-2608-40de-bdd0-890424258440 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:41.714269 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a795eebf-2608-40de-bdd0-890424258440 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.189445 Aug 22 17:27:41.715432 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 83/155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:41 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:41.853511 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-56cca326-cf2b-4149-a05b-b5f2b06546a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:41.854240 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-56cca326-cf2b-4149-a05b-b5f2b06546a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:41.864534 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-56cca326-cf2b-4149-a05b-b5f2b06546a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:41.865152 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-56cca326-cf2b-4149-a05b-b5f2b06546a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:41.865593 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-56cca326-cf2b-4149-a05b-b5f2b06546a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:41.866310 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-56cca326-cf2b-4149-a05b-b5f2b06546a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:41.866793 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-56cca326-cf2b-4149-a05b-b5f2b06546a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:41.867301 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-56cca326-cf2b-4149-a05b-b5f2b06546a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:42.026444 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-56cca326-cf2b-4149-a05b-b5f2b06546a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:42.035874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-56cca326-cf2b-4149-a05b-b5f2b06546a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.186445 Aug 22 17:27:42.037308 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 73/156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:41 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:42.178412 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5c9b4d53-ac1e-44f9-a0a8-d363304da9bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:42.179119 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5c9b4d53-ac1e-44f9-a0a8-d363304da9bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:42.185645 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5c9b4d53-ac1e-44f9-a0a8-d363304da9bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:42.186125 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5c9b4d53-ac1e-44f9-a0a8-d363304da9bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:42.186593 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5c9b4d53-ac1e-44f9-a0a8-d363304da9bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:42.187292 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5c9b4d53-ac1e-44f9-a0a8-d363304da9bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:42.187737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5c9b4d53-ac1e-44f9-a0a8-d363304da9bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:42.188155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5c9b4d53-ac1e-44f9-a0a8-d363304da9bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:42.360299 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5c9b4d53-ac1e-44f9-a0a8-d363304da9bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:42.380795 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5c9b4d53-ac1e-44f9-a0a8-d363304da9bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:42.383110 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5c9b4d53-ac1e-44f9-a0a8-d363304da9bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:42.384770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5c9b4d53-ac1e-44f9-a0a8-d363304da9bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.212178 Aug 22 17:27:42.385731 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 84/157] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:42 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:42.460191 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d8e0084f-2aec-46b7-8113-ec6f8bbecacb tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:42.460828 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d8e0084f-2aec-46b7-8113-ec6f8bbecacb tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:42.468295 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8e0084f-2aec-46b7-8113-ec6f8bbecacb tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:42.469037 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8e0084f-2aec-46b7-8113-ec6f8bbecacb tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:42.469692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8e0084f-2aec-46b7-8113-ec6f8bbecacb tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:42.470700 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8e0084f-2aec-46b7-8113-ec6f8bbecacb tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:42.471367 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8e0084f-2aec-46b7-8113-ec6f8bbecacb tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:42.472011 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8e0084f-2aec-46b7-8113-ec6f8bbecacb tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:42.657656 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d8e0084f-2aec-46b7-8113-ec6f8bbecacb tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:42.668830 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d8e0084f-2aec-46b7-8113-ec6f8bbecacb tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.213916 Aug 22 17:27:42.669416 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 74/158] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:42 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:42.740024 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a9031dc5-f39a-4b4d-b48c-94e523f55d6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:42.741247 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a9031dc5-f39a-4b4d-b48c-94e523f55d6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:42.750475 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9031dc5-f39a-4b4d-b48c-94e523f55d6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:42.751144 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9031dc5-f39a-4b4d-b48c-94e523f55d6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:42.751773 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9031dc5-f39a-4b4d-b48c-94e523f55d6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:42.752630 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9031dc5-f39a-4b4d-b48c-94e523f55d6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:42.753177 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9031dc5-f39a-4b4d-b48c-94e523f55d6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:42.753694 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9031dc5-f39a-4b4d-b48c-94e523f55d6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:42.923952 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a9031dc5-f39a-4b4d-b48c-94e523f55d6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:42.932919 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a9031dc5-f39a-4b4d-b48c-94e523f55d6c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.199143 Aug 22 17:27:42.933513 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 85/159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:42 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:43.067463 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c5c0371f-0f66-443c-897a-7e5902bf4584 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:43.068801 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c5c0371f-0f66-443c-897a-7e5902bf4584 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:43.075692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c5c0371f-0f66-443c-897a-7e5902bf4584 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:43.076210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c5c0371f-0f66-443c-897a-7e5902bf4584 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:43.076643 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c5c0371f-0f66-443c-897a-7e5902bf4584 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:43.077458 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c5c0371f-0f66-443c-897a-7e5902bf4584 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:43.077958 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c5c0371f-0f66-443c-897a-7e5902bf4584 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:43.078374 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c5c0371f-0f66-443c-897a-7e5902bf4584 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:43.240328 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c5c0371f-0f66-443c-897a-7e5902bf4584 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:43.249040 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c5c0371f-0f66-443c-897a-7e5902bf4584 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.185606 Aug 22 17:27:43.249937 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 75/160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:43 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:43.414117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6930cf54-b4b6-4cee-a6de-d906992b643e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:43.414839 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6930cf54-b4b6-4cee-a6de-d906992b643e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:43.421186 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6930cf54-b4b6-4cee-a6de-d906992b643e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:43.421668 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6930cf54-b4b6-4cee-a6de-d906992b643e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:43.422099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6930cf54-b4b6-4cee-a6de-d906992b643e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:43.422832 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6930cf54-b4b6-4cee-a6de-d906992b643e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:43.423281 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6930cf54-b4b6-4cee-a6de-d906992b643e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:43.423759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6930cf54-b4b6-4cee-a6de-d906992b643e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:43.666906 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6930cf54-b4b6-4cee-a6de-d906992b643e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:43.683633 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6930cf54-b4b6-4cee-a6de-d906992b643e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:43.695038 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-eb6eb0ec-1f84-4e89-9220-a7ed4cec243d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:43.700202 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-eb6eb0ec-1f84-4e89-9220-a7ed4cec243d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:43.700752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6930cf54-b4b6-4cee-a6de-d906992b643e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:43.701679 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6930cf54-b4b6-4cee-a6de-d906992b643e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.292072 Aug 22 17:27:43.702578 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 86/161] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:43 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:43.706823 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-eb6eb0ec-1f84-4e89-9220-a7ed4cec243d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:43.707772 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-eb6eb0ec-1f84-4e89-9220-a7ed4cec243d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:43.709414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-eb6eb0ec-1f84-4e89-9220-a7ed4cec243d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:43.710805 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-eb6eb0ec-1f84-4e89-9220-a7ed4cec243d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:43.711502 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-eb6eb0ec-1f84-4e89-9220-a7ed4cec243d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:43.712315 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-eb6eb0ec-1f84-4e89-9220-a7ed4cec243d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:43.956117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-da3269e1-b719-4027-973b-636e9138a280 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:43.957186 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-da3269e1-b719-4027-973b-636e9138a280 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:43.970563 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da3269e1-b719-4027-973b-636e9138a280 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:43.971576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da3269e1-b719-4027-973b-636e9138a280 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:43.972227 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da3269e1-b719-4027-973b-636e9138a280 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:43.973168 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da3269e1-b719-4027-973b-636e9138a280 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:43.974717 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da3269e1-b719-4027-973b-636e9138a280 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:43.978916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da3269e1-b719-4027-973b-636e9138a280 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:44.343518 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-eb6eb0ec-1f84-4e89-9220-a7ed4cec243d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:44.362220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-eb6eb0ec-1f84-4e89-9220-a7ed4cec243d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.673994 Aug 22 17:27:44.384039 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 76/162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:43 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:44.408393 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e1a653f8-224b-45e8-9a74-7498a7257b81 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:44.409512 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e1a653f8-224b-45e8-9a74-7498a7257b81 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:44.421273 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e1a653f8-224b-45e8-9a74-7498a7257b81 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:44.422129 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e1a653f8-224b-45e8-9a74-7498a7257b81 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:44.423156 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e1a653f8-224b-45e8-9a74-7498a7257b81 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:44.437227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e1a653f8-224b-45e8-9a74-7498a7257b81 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:44.438153 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e1a653f8-224b-45e8-9a74-7498a7257b81 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:44.441182 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e1a653f8-224b-45e8-9a74-7498a7257b81 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:44.657484 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-da3269e1-b719-4027-973b-636e9138a280 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:44.678204 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-da3269e1-b719-4027-973b-636e9138a280 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.725643 Aug 22 17:27:44.680514 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 87/163] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:43 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:44.736530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-16e18a56-2563-40e1-b6f0-086fa4c6021f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:44.739709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-16e18a56-2563-40e1-b6f0-086fa4c6021f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:44.772734 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e1a653f8-224b-45e8-9a74-7498a7257b81 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:44.782581 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-16e18a56-2563-40e1-b6f0-086fa4c6021f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:44.787597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-16e18a56-2563-40e1-b6f0-086fa4c6021f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:44.791583 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-16e18a56-2563-40e1-b6f0-086fa4c6021f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:44.794442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-16e18a56-2563-40e1-b6f0-086fa4c6021f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:44.800179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-16e18a56-2563-40e1-b6f0-086fa4c6021f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:44.801512 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-16e18a56-2563-40e1-b6f0-086fa4c6021f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:44.811325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e1a653f8-224b-45e8-9a74-7498a7257b81 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.422921 Aug 22 17:27:44.827742 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 77/164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:44 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:45.247473 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-16e18a56-2563-40e1-b6f0-086fa4c6021f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:45.274173 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-16e18a56-2563-40e1-b6f0-086fa4c6021f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:45.279700 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-16e18a56-2563-40e1-b6f0-086fa4c6021f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:45.284304 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-16e18a56-2563-40e1-b6f0-086fa4c6021f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.558270 Aug 22 17:27:45.290915 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 88/165] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:44 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:27:45.414607 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-768af284-3a5c-45dc-b195-0d2f8a88a5e8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:45.415630 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-768af284-3a5c-45dc-b195-0d2f8a88a5e8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:45.427511 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-768af284-3a5c-45dc-b195-0d2f8a88a5e8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:45.428561 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-768af284-3a5c-45dc-b195-0d2f8a88a5e8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:45.429189 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-768af284-3a5c-45dc-b195-0d2f8a88a5e8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:45.430589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-768af284-3a5c-45dc-b195-0d2f8a88a5e8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:45.431481 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-768af284-3a5c-45dc-b195-0d2f8a88a5e8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:45.432739 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-768af284-3a5c-45dc-b195-0d2f8a88a5e8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:45.483149 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-2ccaafe8-3dff-4e72-a300-00bc8d2bad3f req-b8964e15-d27b-440a-b28b-be0c2e08701f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4763726-f1d6-476a-b919-ad30acd9fcc4", "name": "network-vif-plugged", "status": "completed", "tag": "0dda04d1-36ae-4c21-ac5d-063913579bea"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:27:45.498159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-2ccaafe8-3dff-4e72-a300-00bc8d2bad3f req-b8964e15-d27b-440a-b28b-be0c2e08701f service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:45.504368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-2ccaafe8-3dff-4e72-a300-00bc8d2bad3f req-b8964e15-d27b-440a-b28b-be0c2e08701f service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:45.507011 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-2ccaafe8-3dff-4e72-a300-00bc8d2bad3f req-b8964e15-d27b-440a-b28b-be0c2e08701f service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:45.524485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-2ccaafe8-3dff-4e72-a300-00bc8d2bad3f req-b8964e15-d27b-440a-b28b-be0c2e08701f service nova] Creating event network-vif-plugged:0dda04d1-36ae-4c21-ac5d-063913579bea for instance e4763726-f1d6-476a-b919-ad30acd9fcc4 on hv-cinder-85394 Aug 22 17:27:45.531110 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-2ccaafe8-3dff-4e72-a300-00bc8d2bad3f req-b8964e15-d27b-440a-b28b-be0c2e08701f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051039 Aug 22 17:27:45.532526 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 89/166] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:27:45.637640 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-768af284-3a5c-45dc-b195-0d2f8a88a5e8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:45.652193 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-768af284-3a5c-45dc-b195-0d2f8a88a5e8 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.244246 Aug 22 17:27:45.653263 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 78/167] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:45 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:45.712669 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8a413fde-6f29-4357-a0b2-48d242f15676 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:45.717991 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8a413fde-6f29-4357-a0b2-48d242f15676 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:45.741689 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a413fde-6f29-4357-a0b2-48d242f15676 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:45.741689 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a413fde-6f29-4357-a0b2-48d242f15676 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:45.741689 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a413fde-6f29-4357-a0b2-48d242f15676 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:45.741689 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a413fde-6f29-4357-a0b2-48d242f15676 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:45.742350 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a413fde-6f29-4357-a0b2-48d242f15676 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:45.742350 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a413fde-6f29-4357-a0b2-48d242f15676 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:45.871638 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8f071b0a-94f5-4ce3-ae9d-c2143f4c2456 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:45.872760 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8f071b0a-94f5-4ce3-ae9d-c2143f4c2456 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:45.897859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8f071b0a-94f5-4ce3-ae9d-c2143f4c2456 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:45.898876 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8f071b0a-94f5-4ce3-ae9d-c2143f4c2456 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:45.899655 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8f071b0a-94f5-4ce3-ae9d-c2143f4c2456 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:45.900921 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8f071b0a-94f5-4ce3-ae9d-c2143f4c2456 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:45.901747 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8f071b0a-94f5-4ce3-ae9d-c2143f4c2456 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:45.903195 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8f071b0a-94f5-4ce3-ae9d-c2143f4c2456 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:45.965206 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8a413fde-6f29-4357-a0b2-48d242f15676 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:45.970720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=100 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:45.977217 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8a413fde-6f29-4357-a0b2-48d242f15676 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.275460 Aug 22 17:27:45.977833 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 90/168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:45 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:46.136497 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8f071b0a-94f5-4ce3-ae9d-c2143f4c2456 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:46.145483 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8f071b0a-94f5-4ce3-ae9d-c2143f4c2456 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.287446 Aug 22 17:27:46.147604 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 79/169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:45 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:46.327067 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5a6861df-bc70-4582-86b0-0bd5e5d5c88d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:46.327808 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5a6861df-bc70-4582-86b0-0bd5e5d5c88d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:46.335390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a6861df-bc70-4582-86b0-0bd5e5d5c88d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:46.335992 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a6861df-bc70-4582-86b0-0bd5e5d5c88d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:46.336533 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a6861df-bc70-4582-86b0-0bd5e5d5c88d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:46.337620 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a6861df-bc70-4582-86b0-0bd5e5d5c88d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:46.338195 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a6861df-bc70-4582-86b0-0bd5e5d5c88d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:46.338749 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a6861df-bc70-4582-86b0-0bd5e5d5c88d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:46.528135 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5a6861df-bc70-4582-86b0-0bd5e5d5c88d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:46.541466 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5a6861df-bc70-4582-86b0-0bd5e5d5c88d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:46.544028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5a6861df-bc70-4582-86b0-0bd5e5d5c88d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:46.546217 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5a6861df-bc70-4582-86b0-0bd5e5d5c88d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.223067 Aug 22 17:27:46.561876 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 91/170] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:46 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:46.686509 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b8386352-fdb6-40d1-9c33-15fe52a90dd0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:46.687420 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b8386352-fdb6-40d1-9c33-15fe52a90dd0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:46.698414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b8386352-fdb6-40d1-9c33-15fe52a90dd0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:46.698414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b8386352-fdb6-40d1-9c33-15fe52a90dd0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:46.698414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b8386352-fdb6-40d1-9c33-15fe52a90dd0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:46.698414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b8386352-fdb6-40d1-9c33-15fe52a90dd0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:46.698888 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b8386352-fdb6-40d1-9c33-15fe52a90dd0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:46.698888 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b8386352-fdb6-40d1-9c33-15fe52a90dd0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:46.722917 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=100 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:46.874794 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b8386352-fdb6-40d1-9c33-15fe52a90dd0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:46.888841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b8386352-fdb6-40d1-9c33-15fe52a90dd0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.205742 Aug 22 17:27:46.890637 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 80/171] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:46 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:47.008613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f4b8a559-9dad-459b-8c94-66307f9da9b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:47.009449 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f4b8a559-9dad-459b-8c94-66307f9da9b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:47.024557 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=95 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:27:47.030337 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f4b8a559-9dad-459b-8c94-66307f9da9b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:47.034701 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f4b8a559-9dad-459b-8c94-66307f9da9b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:47.038817 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f4b8a559-9dad-459b-8c94-66307f9da9b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:47.039694 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f4b8a559-9dad-459b-8c94-66307f9da9b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:47.040233 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f4b8a559-9dad-459b-8c94-66307f9da9b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:47.040663 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f4b8a559-9dad-459b-8c94-66307f9da9b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:47.184078 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0802afe3-b86a-4961-9e56-69782fef6506 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:47.185114 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0802afe3-b86a-4961-9e56-69782fef6506 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:47.193493 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0802afe3-b86a-4961-9e56-69782fef6506 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:47.195212 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0802afe3-b86a-4961-9e56-69782fef6506 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:47.199431 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0802afe3-b86a-4961-9e56-69782fef6506 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:47.200584 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0802afe3-b86a-4961-9e56-69782fef6506 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:47.201383 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0802afe3-b86a-4961-9e56-69782fef6506 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:47.210435 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0802afe3-b86a-4961-9e56-69782fef6506 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:47.279144 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f4b8a559-9dad-459b-8c94-66307f9da9b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:47.307645 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f4b8a559-9dad-459b-8c94-66307f9da9b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.308017 Aug 22 17:27:47.307645 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 92/172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:46 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:47.538432 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0802afe3-b86a-4961-9e56-69782fef6506 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:47.556912 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-40f6848d-2f15-4979-91ad-e656bacdc3e0 req-791b1da4-a580-4285-90fd-92147b6ed882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb3959b-fd48-4a97-81d0-5b74ec4cfd32", "name": "network-vif-plugged", "status": "completed", "tag": "703038a4-7ff6-4222-b6d6-2865ce69bda5"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:27:47.557256 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0802afe3-b86a-4961-9e56-69782fef6506 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1322 microversion: 2.1 time: 0.390456 Aug 22 17:27:47.558720 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 81/173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:47 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1322 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:47.568548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-40f6848d-2f15-4979-91ad-e656bacdc3e0 req-791b1da4-a580-4285-90fd-92147b6ed882 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:47.569033 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-40f6848d-2f15-4979-91ad-e656bacdc3e0 req-791b1da4-a580-4285-90fd-92147b6ed882 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:47.569722 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-40f6848d-2f15-4979-91ad-e656bacdc3e0 req-791b1da4-a580-4285-90fd-92147b6ed882 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:47.585668 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-54532d37-19b8-427f-821e-04b8263fa72b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:47.601510 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-54532d37-19b8-427f-821e-04b8263fa72b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:47.604587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-54532d37-19b8-427f-821e-04b8263fa72b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:47.606200 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-54532d37-19b8-427f-821e-04b8263fa72b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:47.607389 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-54532d37-19b8-427f-821e-04b8263fa72b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:47.609057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-54532d37-19b8-427f-821e-04b8263fa72b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:47.611408 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-54532d37-19b8-427f-821e-04b8263fa72b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:47.611852 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-54532d37-19b8-427f-821e-04b8263fa72b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:47.613648 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-40f6848d-2f15-4979-91ad-e656bacdc3e0 req-791b1da4-a580-4285-90fd-92147b6ed882 service nova] Creating event network-vif-plugged:703038a4-7ff6-4222-b6d6-2865ce69bda5 for instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 on hv-cinder-85394 Aug 22 17:27:47.633736 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-40f6848d-2f15-4979-91ad-e656bacdc3e0 req-791b1da4-a580-4285-90fd-92147b6ed882 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080254 Aug 22 17:27:47.634316 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 93/174] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:27:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:27:47.857598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-54532d37-19b8-427f-821e-04b8263fa72b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:47.868272 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-54532d37-19b8-427f-821e-04b8263fa72b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:47.869862 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-54532d37-19b8-427f-821e-04b8263fa72b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:47.871150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-54532d37-19b8-427f-821e-04b8263fa72b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.304287 Aug 22 17:27:47.871805 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 82/175] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:47 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:47.929615 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-df9098b1-988a-4250-8bf8-611b73d8fdb5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:47.930936 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-df9098b1-988a-4250-8bf8-611b73d8fdb5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:47.944649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df9098b1-988a-4250-8bf8-611b73d8fdb5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:47.945494 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df9098b1-988a-4250-8bf8-611b73d8fdb5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:47.946293 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df9098b1-988a-4250-8bf8-611b73d8fdb5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:47.947675 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df9098b1-988a-4250-8bf8-611b73d8fdb5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:47.948524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df9098b1-988a-4250-8bf8-611b73d8fdb5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:47.949308 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df9098b1-988a-4250-8bf8-611b73d8fdb5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:48.277415 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-df9098b1-988a-4250-8bf8-611b73d8fdb5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:48.289866 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-df9098b1-988a-4250-8bf8-611b73d8fdb5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1314 microversion: 2.1 time: 0.368009 Aug 22 17:27:48.291064 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 94/176] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:47 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:48.351076 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4e7b8f82-747e-4067-af56-c23931eb6491 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:48.353625 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4e7b8f82-747e-4067-af56-c23931eb6491 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:48.372230 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e7b8f82-747e-4067-af56-c23931eb6491 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:48.373459 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e7b8f82-747e-4067-af56-c23931eb6491 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:48.374229 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e7b8f82-747e-4067-af56-c23931eb6491 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:48.375592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e7b8f82-747e-4067-af56-c23931eb6491 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:48.376617 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e7b8f82-747e-4067-af56-c23931eb6491 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:48.377547 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e7b8f82-747e-4067-af56-c23931eb6491 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:48.593153 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4b5893cc-29a9-4b61-aa2a-a6c0514e267f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:48.594099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4b5893cc-29a9-4b61-aa2a-a6c0514e267f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:48.611797 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4b5893cc-29a9-4b61-aa2a-a6c0514e267f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:48.621154 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4b5893cc-29a9-4b61-aa2a-a6c0514e267f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:48.621867 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4b5893cc-29a9-4b61-aa2a-a6c0514e267f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:48.623793 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4b5893cc-29a9-4b61-aa2a-a6c0514e267f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:48.624536 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4b5893cc-29a9-4b61-aa2a-a6c0514e267f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:48.629427 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4b5893cc-29a9-4b61-aa2a-a6c0514e267f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:48.641318 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4e7b8f82-747e-4067-af56-c23931eb6491 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:48.660824 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4e7b8f82-747e-4067-af56-c23931eb6491 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.317726 Aug 22 17:27:48.662708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 83/177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:48 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:48.900405 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c1aecf80-c885-4b20-b887-ccfd41958cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:48.901227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c1aecf80-c885-4b20-b887-ccfd41958cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:48.908093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1aecf80-c885-4b20-b887-ccfd41958cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:48.908587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1aecf80-c885-4b20-b887-ccfd41958cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:48.909023 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1aecf80-c885-4b20-b887-ccfd41958cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:48.909775 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1aecf80-c885-4b20-b887-ccfd41958cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:48.910287 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1aecf80-c885-4b20-b887-ccfd41958cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:48.910744 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1aecf80-c885-4b20-b887-ccfd41958cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:48.985376 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4b5893cc-29a9-4b61-aa2a-a6c0514e267f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:48.997859 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4b5893cc-29a9-4b61-aa2a-a6c0514e267f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1516 microversion: 2.1 time: 0.410259 Aug 22 17:27:48.998821 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 95/178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:48 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1516 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:49.026375 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c30ed205-56de-4de5-8382-6ac55b0b165b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:27:49.029095 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c30ed205-56de-4de5-8382-6ac55b0b165b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:49.036766 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c30ed205-56de-4de5-8382-6ac55b0b165b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:49.037708 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c30ed205-56de-4de5-8382-6ac55b0b165b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:49.038368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c30ed205-56de-4de5-8382-6ac55b0b165b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:49.039561 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c30ed205-56de-4de5-8382-6ac55b0b165b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:49.040254 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c30ed205-56de-4de5-8382-6ac55b0b165b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:49.040918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c30ed205-56de-4de5-8382-6ac55b0b165b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:49.088868 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c1aecf80-c885-4b20-b887-ccfd41958cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:49.106154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c1aecf80-c885-4b20-b887-ccfd41958cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:49.109465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c1aecf80-c885-4b20-b887-ccfd41958cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:49.110086 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-c30ed205-56de-4de5-8382-6ac55b0b165b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lazy-loading 'flavor' on Instance uuid 66262c8d-0245-4a3f-83e8-d3093c6d1057 {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:27:49.112028 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c1aecf80-c885-4b20-b887-ccfd41958cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.216303 Aug 22 17:27:49.113203 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 84/179] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:48 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:27:49.322976 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-73627e1f-dd5e-404e-ac3d-74c36c971b21 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:49.323841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-73627e1f-dd5e-404e-ac3d-74c36c971b21 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:49.333179 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-73627e1f-dd5e-404e-ac3d-74c36c971b21 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:49.333647 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-73627e1f-dd5e-404e-ac3d-74c36c971b21 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:49.333908 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-73627e1f-dd5e-404e-ac3d-74c36c971b21 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:49.334953 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-73627e1f-dd5e-404e-ac3d-74c36c971b21 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:49.335558 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-73627e1f-dd5e-404e-ac3d-74c36c971b21 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:49.336131 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-73627e1f-dd5e-404e-ac3d-74c36c971b21 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:49.519161 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-73627e1f-dd5e-404e-ac3d-74c36c971b21 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:49.546811 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-73627e1f-dd5e-404e-ac3d-74c36c971b21 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1502 microversion: 2.1 time: 0.235282 Aug 22 17:27:49.551411 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 85/180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:49 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1502 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:49.612754 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c30ed205-56de-4de5-8382-6ac55b0b165b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "POST /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057/action" status: 200 len: 32 microversion: 2.1 time: 0.591955 Aug 22 17:27:49.615009 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 96/181] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 22 17:27:49 2022] POST /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057/action => generated 32 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:27:49.627863 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0272e19d-c27f-4d14-9299-6fc65f23eed8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:49.630808 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0272e19d-c27f-4d14-9299-6fc65f23eed8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:49.640520 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0272e19d-c27f-4d14-9299-6fc65f23eed8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:49.641122 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0272e19d-c27f-4d14-9299-6fc65f23eed8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:49.641567 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0272e19d-c27f-4d14-9299-6fc65f23eed8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:49.642304 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0272e19d-c27f-4d14-9299-6fc65f23eed8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:49.646009 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0272e19d-c27f-4d14-9299-6fc65f23eed8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:49.647582 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0272e19d-c27f-4d14-9299-6fc65f23eed8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:49.692179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-d8cca44f-2809-4d37-9625-265e6df63bb6 req-198448a8-23e0-47f3-bc08-07f576ace4da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c1f97f-c673-4f7b-8ecf-45396ce57516", "name": "network-vif-plugged", "status": "completed", "tag": "acf48248-cd4c-42ff-9f56-03f04156294f"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:27:49.711527 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-d8cca44f-2809-4d37-9625-265e6df63bb6 req-198448a8-23e0-47f3-bc08-07f576ace4da service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:49.712752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-d8cca44f-2809-4d37-9625-265e6df63bb6 req-198448a8-23e0-47f3-bc08-07f576ace4da service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:49.716878 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-d8cca44f-2809-4d37-9625-265e6df63bb6 req-198448a8-23e0-47f3-bc08-07f576ace4da service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:49.756601 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-d8cca44f-2809-4d37-9625-265e6df63bb6 req-198448a8-23e0-47f3-bc08-07f576ace4da service nova] Creating event network-vif-plugged:acf48248-cd4c-42ff-9f56-03f04156294f for instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 on hv-cinder-85394 Aug 22 17:27:49.763814 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-d8cca44f-2809-4d37-9625-265e6df63bb6 req-198448a8-23e0-47f3-bc08-07f576ace4da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079130 Aug 22 17:27:49.770838 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 97/182] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:27:49.779043 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-132845de-ad9f-4ae7-9cf2-e0e0c5e1e907 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:49.780414 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-132845de-ad9f-4ae7-9cf2-e0e0c5e1e907 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:49.789512 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-132845de-ad9f-4ae7-9cf2-e0e0c5e1e907 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:49.795343 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-132845de-ad9f-4ae7-9cf2-e0e0c5e1e907 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:49.795343 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-132845de-ad9f-4ae7-9cf2-e0e0c5e1e907 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:49.795343 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-132845de-ad9f-4ae7-9cf2-e0e0c5e1e907 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:49.795343 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-132845de-ad9f-4ae7-9cf2-e0e0c5e1e907 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:49.795749 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-132845de-ad9f-4ae7-9cf2-e0e0c5e1e907 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:50.022900 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0272e19d-c27f-4d14-9299-6fc65f23eed8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:50.041455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0272e19d-c27f-4d14-9299-6fc65f23eed8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.421087 Aug 22 17:27:50.043017 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 86/183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:49 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:50.090280 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-132845de-ad9f-4ae7-9cf2-e0e0c5e1e907 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:50.098157 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-132845de-ad9f-4ae7-9cf2-e0e0c5e1e907 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.324848 Aug 22 17:27:50.100118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 98/184] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:49 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:50.149617 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-86127ecf-1813-4b88-9178-53ebce8baf63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:50.150241 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-86127ecf-1813-4b88-9178-53ebce8baf63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:50.156302 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-86127ecf-1813-4b88-9178-53ebce8baf63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:50.156850 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-86127ecf-1813-4b88-9178-53ebce8baf63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:50.157287 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-86127ecf-1813-4b88-9178-53ebce8baf63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:50.157991 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-86127ecf-1813-4b88-9178-53ebce8baf63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:50.158451 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-86127ecf-1813-4b88-9178-53ebce8baf63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:50.158912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-86127ecf-1813-4b88-9178-53ebce8baf63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:50.427782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-86127ecf-1813-4b88-9178-53ebce8baf63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:50.437966 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-86127ecf-1813-4b88-9178-53ebce8baf63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:50.440546 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-86127ecf-1813-4b88-9178-53ebce8baf63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:50.441493 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-86127ecf-1813-4b88-9178-53ebce8baf63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.296075 Aug 22 17:27:50.442173 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 87/185] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:50 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:51.064836 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-babc7124-d016-459a-8f5b-1310a38c88f3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:51.065579 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-babc7124-d016-459a-8f5b-1310a38c88f3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:51.078673 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-babc7124-d016-459a-8f5b-1310a38c88f3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:51.078673 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-babc7124-d016-459a-8f5b-1310a38c88f3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:51.078673 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-babc7124-d016-459a-8f5b-1310a38c88f3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:51.078673 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-babc7124-d016-459a-8f5b-1310a38c88f3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:51.079078 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-babc7124-d016-459a-8f5b-1310a38c88f3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:51.079078 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-babc7124-d016-459a-8f5b-1310a38c88f3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:51.122066 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d361c77e-4bd6-4a8e-a0ff-d7863793a973 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:51.123157 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d361c77e-4bd6-4a8e-a0ff-d7863793a973 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:51.134764 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d361c77e-4bd6-4a8e-a0ff-d7863793a973 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:51.134764 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d361c77e-4bd6-4a8e-a0ff-d7863793a973 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:51.134764 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d361c77e-4bd6-4a8e-a0ff-d7863793a973 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:51.135197 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d361c77e-4bd6-4a8e-a0ff-d7863793a973 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:51.135797 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d361c77e-4bd6-4a8e-a0ff-d7863793a973 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:51.136309 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d361c77e-4bd6-4a8e-a0ff-d7863793a973 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:51.324285 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-babc7124-d016-459a-8f5b-1310a38c88f3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:51.345007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-babc7124-d016-459a-8f5b-1310a38c88f3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.284454 Aug 22 17:27:51.347892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 99/186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:51 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:51.472424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f74a8e45-fb81-476f-b783-6e1c23d0d78f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:51.474108 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f74a8e45-fb81-476f-b783-6e1c23d0d78f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:51.516967 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f74a8e45-fb81-476f-b783-6e1c23d0d78f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:51.516967 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f74a8e45-fb81-476f-b783-6e1c23d0d78f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:51.516967 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f74a8e45-fb81-476f-b783-6e1c23d0d78f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:51.516967 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f74a8e45-fb81-476f-b783-6e1c23d0d78f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:51.517266 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f74a8e45-fb81-476f-b783-6e1c23d0d78f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:51.517266 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f74a8e45-fb81-476f-b783-6e1c23d0d78f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:51.629402 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d361c77e-4bd6-4a8e-a0ff-d7863793a973 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:51.639555 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d361c77e-4bd6-4a8e-a0ff-d7863793a973 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.522524 Aug 22 17:27:51.640264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 88/187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:51 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:51.729654 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f74a8e45-fb81-476f-b783-6e1c23d0d78f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:51.738843 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f74a8e45-fb81-476f-b783-6e1c23d0d78f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:51.741566 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f74a8e45-fb81-476f-b783-6e1c23d0d78f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:51.742822 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f74a8e45-fb81-476f-b783-6e1c23d0d78f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1406 microversion: 2.20 time: 0.280980 Aug 22 17:27:51.743386 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 100/188] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:51 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:52.384428 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5739ae6d-45d5-4bc9-96c9-0b2ff26543a2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:52.385283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5739ae6d-45d5-4bc9-96c9-0b2ff26543a2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:52.393313 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5739ae6d-45d5-4bc9-96c9-0b2ff26543a2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:52.393895 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5739ae6d-45d5-4bc9-96c9-0b2ff26543a2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:52.394652 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5739ae6d-45d5-4bc9-96c9-0b2ff26543a2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:52.396032 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5739ae6d-45d5-4bc9-96c9-0b2ff26543a2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:52.396575 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5739ae6d-45d5-4bc9-96c9-0b2ff26543a2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:52.397205 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5739ae6d-45d5-4bc9-96c9-0b2ff26543a2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:52.599819 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5739ae6d-45d5-4bc9-96c9-0b2ff26543a2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:52.616597 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5739ae6d-45d5-4bc9-96c9-0b2ff26543a2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.237240 Aug 22 17:27:52.647214 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 89/189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:52 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:52.679794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-85ad5362-bb56-4a27-a271-d2720fa6249c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:52.680909 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-85ad5362-bb56-4a27-a271-d2720fa6249c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:52.690940 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-85ad5362-bb56-4a27-a271-d2720fa6249c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:52.691830 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-85ad5362-bb56-4a27-a271-d2720fa6249c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:52.693408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-85ad5362-bb56-4a27-a271-d2720fa6249c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:52.694750 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-85ad5362-bb56-4a27-a271-d2720fa6249c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:52.695833 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-85ad5362-bb56-4a27-a271-d2720fa6249c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:52.696626 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-85ad5362-bb56-4a27-a271-d2720fa6249c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:52.766354 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ec3d93dc-eb42-4b66-96c0-c2821dfaa72e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:52.767031 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ec3d93dc-eb42-4b66-96c0-c2821dfaa72e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:52.783106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ec3d93dc-eb42-4b66-96c0-c2821dfaa72e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:52.784000 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ec3d93dc-eb42-4b66-96c0-c2821dfaa72e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:52.784864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ec3d93dc-eb42-4b66-96c0-c2821dfaa72e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:52.787154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ec3d93dc-eb42-4b66-96c0-c2821dfaa72e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:52.787659 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ec3d93dc-eb42-4b66-96c0-c2821dfaa72e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:52.788401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ec3d93dc-eb42-4b66-96c0-c2821dfaa72e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:53.014425 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-85ad5362-bb56-4a27-a271-d2720fa6249c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:53.023929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-85ad5362-bb56-4a27-a271-d2720fa6249c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1366 microversion: 2.1 time: 0.352058 Aug 22 17:27:53.028551 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 101/190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:52 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:53.088130 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-7ff894ee-633c-46c1-af26-6be969bea3f0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae0bcd8e-d22f-46f7-834e-04914696f1b8"}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:27:53.091097 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-7ff894ee-633c-46c1-af26-6be969bea3f0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:53.108824 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7ff894ee-633c-46c1-af26-6be969bea3f0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:53.116006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7ff894ee-633c-46c1-af26-6be969bea3f0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:53.116684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7ff894ee-633c-46c1-af26-6be969bea3f0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:53.117626 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7ff894ee-633c-46c1-af26-6be969bea3f0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:53.119476 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7ff894ee-633c-46c1-af26-6be969bea3f0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:53.124918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7ff894ee-633c-46c1-af26-6be969bea3f0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:53.240389 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ec3d93dc-eb42-4b66-96c0-c2821dfaa72e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:53.250927 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ec3d93dc-eb42-4b66-96c0-c2821dfaa72e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:53.253128 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ec3d93dc-eb42-4b66-96c0-c2821dfaa72e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:53.254337 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ec3d93dc-eb42-4b66-96c0-c2821dfaa72e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1597 microversion: 2.20 time: 0.492156 Aug 22 17:27:53.255352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 90/191] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:27:52 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1597 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:27:53.299995 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-71675fba-f558-4cd6-8674-407ade6c7b06 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:53.300864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-71675fba-f558-4cd6-8674-407ade6c7b06 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:53.310644 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-71675fba-f558-4cd6-8674-407ade6c7b06 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:53.315197 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-71675fba-f558-4cd6-8674-407ade6c7b06 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:53.317490 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-71675fba-f558-4cd6-8674-407ade6c7b06 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:53.320193 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-71675fba-f558-4cd6-8674-407ade6c7b06 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:53.320728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-71675fba-f558-4cd6-8674-407ade6c7b06 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:53.321167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-71675fba-f558-4cd6-8674-407ade6c7b06 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:53.472137 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-71675fba-f558-4cd6-8674-407ade6c7b06 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.179562 Aug 22 17:27:53.472775 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 91/192] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Aug 22 17:27:53 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/os-interface => generated 284 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:27:53.672810 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d2ce03b3-5db8-4e6c-8e3a-b1e6255f9859 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:53.674863 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d2ce03b3-5db8-4e6c-8e3a-b1e6255f9859 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:53.686349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d2ce03b3-5db8-4e6c-8e3a-b1e6255f9859 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:53.687254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d2ce03b3-5db8-4e6c-8e3a-b1e6255f9859 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:53.688303 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d2ce03b3-5db8-4e6c-8e3a-b1e6255f9859 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:53.689562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d2ce03b3-5db8-4e6c-8e3a-b1e6255f9859 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:53.690334 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d2ce03b3-5db8-4e6c-8e3a-b1e6255f9859 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:53.692791 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d2ce03b3-5db8-4e6c-8e3a-b1e6255f9859 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:54.162242 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d2ce03b3-5db8-4e6c-8e3a-b1e6255f9859 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:54.173737 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d2ce03b3-5db8-4e6c-8e3a-b1e6255f9859 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.510755 Aug 22 17:27:54.174323 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 92/193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:53 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:54.190716 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e0eb1f10-891e-40d5-9d50-e1ba155e504c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:54.191346 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e0eb1f10-891e-40d5-9d50-e1ba155e504c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:54.209523 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e0eb1f10-891e-40d5-9d50-e1ba155e504c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:54.211810 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e0eb1f10-891e-40d5-9d50-e1ba155e504c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:54.211810 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e0eb1f10-891e-40d5-9d50-e1ba155e504c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:54.212572 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e0eb1f10-891e-40d5-9d50-e1ba155e504c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:54.213207 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e0eb1f10-891e-40d5-9d50-e1ba155e504c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:54.213639 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e0eb1f10-891e-40d5-9d50-e1ba155e504c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:54.467036 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e0eb1f10-891e-40d5-9d50-e1ba155e504c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:54.478272 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e0eb1f10-891e-40d5-9d50-e1ba155e504c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1555 microversion: 2.1 time: 0.299234 Aug 22 17:27:54.496159 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 93/194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:54 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1555 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:54.501716 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-dd87a40e-5b0b-4eb6-bbde-0cfddc29005d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:54.502220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-dd87a40e-5b0b-4eb6-bbde-0cfddc29005d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:54.509634 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dd87a40e-5b0b-4eb6-bbde-0cfddc29005d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:54.510389 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dd87a40e-5b0b-4eb6-bbde-0cfddc29005d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:54.511026 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dd87a40e-5b0b-4eb6-bbde-0cfddc29005d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:54.511920 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dd87a40e-5b0b-4eb6-bbde-0cfddc29005d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:54.514968 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dd87a40e-5b0b-4eb6-bbde-0cfddc29005d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:54.514968 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dd87a40e-5b0b-4eb6-bbde-0cfddc29005d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:54.700017 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-dd87a40e-5b0b-4eb6-bbde-0cfddc29005d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.202264 Aug 22 17:27:54.702131 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 94/195] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 22 17:27:54 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:27:55.038968 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-7ff894ee-633c-46c1-af26-6be969bea3f0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "POST /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.954870 Aug 22 17:27:55.040205 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 102/196] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 22 17:27:53 2022] POST /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2/os-volume_attachments => generated 194 bytes in 1957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:27:55.212787 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-87a8fced-38ba-40e3-ae02-1fb9bc92121f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:55.213578 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-87a8fced-38ba-40e3-ae02-1fb9bc92121f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:55.221207 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-87a8fced-38ba-40e3-ae02-1fb9bc92121f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:55.221802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-87a8fced-38ba-40e3-ae02-1fb9bc92121f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:55.222375 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-87a8fced-38ba-40e3-ae02-1fb9bc92121f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:55.224194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-87a8fced-38ba-40e3-ae02-1fb9bc92121f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:55.224194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-87a8fced-38ba-40e3-ae02-1fb9bc92121f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:55.224823 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-87a8fced-38ba-40e3-ae02-1fb9bc92121f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:56.088127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-87a8fced-38ba-40e3-ae02-1fb9bc92121f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:56.112154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-87a8fced-38ba-40e3-ae02-1fb9bc92121f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.903895 Aug 22 17:27:56.134616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 95/197] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:55 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:27:57.156154 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-3679e3da-fe38-4775-aee0-2fbb9a1a6e1f req-88d86036-765a-418e-ac71-c22ddc0fc3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcb3959b-fd48-4a97-81d0-5b74ec4cfd32", "tag": "703038a4-7ff6-4222-b6d6-2865ce69bda5"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:27:57.160174 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c01f86ce-907a-4371-954d-a7af1f55f475 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:57.162724 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c01f86ce-907a-4371-954d-a7af1f55f475 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:57.181989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c01f86ce-907a-4371-954d-a7af1f55f475 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:57.183084 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c01f86ce-907a-4371-954d-a7af1f55f475 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:57.184239 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c01f86ce-907a-4371-954d-a7af1f55f475 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:57.186218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c01f86ce-907a-4371-954d-a7af1f55f475 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:57.187124 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c01f86ce-907a-4371-954d-a7af1f55f475 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:57.189253 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c01f86ce-907a-4371-954d-a7af1f55f475 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:57.225033 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-3679e3da-fe38-4775-aee0-2fbb9a1a6e1f req-88d86036-765a-418e-ac71-c22ddc0fc3fc service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:57.225805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-3679e3da-fe38-4775-aee0-2fbb9a1a6e1f req-88d86036-765a-418e-ac71-c22ddc0fc3fc service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:57.237637 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-3679e3da-fe38-4775-aee0-2fbb9a1a6e1f req-88d86036-765a-418e-ac71-c22ddc0fc3fc service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:57.269973 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-3679e3da-fe38-4775-aee0-2fbb9a1a6e1f req-88d86036-765a-418e-ac71-c22ddc0fc3fc service nova] Creating event network-changed:703038a4-7ff6-4222-b6d6-2865ce69bda5 for instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 on hv-cinder-85394 Aug 22 17:27:57.285631 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-3679e3da-fe38-4775-aee0-2fbb9a1a6e1f req-88d86036-765a-418e-ac71-c22ddc0fc3fc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.176166 Aug 22 17:27:57.290102 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 103/198] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:27:58.169052 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c01f86ce-907a-4371-954d-a7af1f55f475 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:27:58.223355 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c01f86ce-907a-4371-954d-a7af1f55f475 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 1.073035 Aug 22 17:27:58.225685 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 96/199] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:57 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:27:58.356772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-61dd3322-ca9c-4dcf-bc5c-9ac0b9835510 req-4ac95284-d988-4140-aa4d-6f5d3deb1b15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c1f97f-c673-4f7b-8ecf-45396ce57516", "tag": "acf48248-cd4c-42ff-9f56-03f04156294f"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:27:58.425092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-61dd3322-ca9c-4dcf-bc5c-9ac0b9835510 req-4ac95284-d988-4140-aa4d-6f5d3deb1b15 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:58.425092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-61dd3322-ca9c-4dcf-bc5c-9ac0b9835510 req-4ac95284-d988-4140-aa4d-6f5d3deb1b15 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:58.425092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-61dd3322-ca9c-4dcf-bc5c-9ac0b9835510 req-4ac95284-d988-4140-aa4d-6f5d3deb1b15 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:58.470851 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-61dd3322-ca9c-4dcf-bc5c-9ac0b9835510 req-4ac95284-d988-4140-aa4d-6f5d3deb1b15 service nova] Creating event network-changed:acf48248-cd4c-42ff-9f56-03f04156294f for instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 on hv-cinder-85394 Aug 22 17:27:58.484099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-61dd3322-ca9c-4dcf-bc5c-9ac0b9835510 req-4ac95284-d988-4140-aa4d-6f5d3deb1b15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138147 Aug 22 17:27:58.485508 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 104/200] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:27:59.291237 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1be5ee3c-727e-45e0-ad84-b8255be6d02e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:27:59.293729 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1be5ee3c-727e-45e0-ad84-b8255be6d02e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:27:59.319801 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1be5ee3c-727e-45e0-ad84-b8255be6d02e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:59.320621 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1be5ee3c-727e-45e0-ad84-b8255be6d02e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:59.321344 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1be5ee3c-727e-45e0-ad84-b8255be6d02e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:27:59.324678 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1be5ee3c-727e-45e0-ad84-b8255be6d02e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:27:59.330426 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1be5ee3c-727e-45e0-ad84-b8255be6d02e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:27:59.331677 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1be5ee3c-727e-45e0-ad84-b8255be6d02e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:00.130789 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1be5ee3c-727e-45e0-ad84-b8255be6d02e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:00.135702 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=100 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:00.142515 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1be5ee3c-727e-45e0-ad84-b8255be6d02e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.858996 Aug 22 17:28:00.143384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 97/201] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:27:59 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:01.177028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e9c3d3cb-62db-4e26-a5f6-730532afc911 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:01.177999 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e9c3d3cb-62db-4e26-a5f6-730532afc911 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:01.184997 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9c3d3cb-62db-4e26-a5f6-730532afc911 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:01.185479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9c3d3cb-62db-4e26-a5f6-730532afc911 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:01.185909 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9c3d3cb-62db-4e26-a5f6-730532afc911 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:01.186653 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9c3d3cb-62db-4e26-a5f6-730532afc911 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:01.187107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9c3d3cb-62db-4e26-a5f6-730532afc911 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:01.187573 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9c3d3cb-62db-4e26-a5f6-730532afc911 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:01.375978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e9c3d3cb-62db-4e26-a5f6-730532afc911 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:01.394707 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e9c3d3cb-62db-4e26-a5f6-730532afc911 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.224952 Aug 22 17:28:01.395777 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 105/202] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:01 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:02.429950 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-163ac0f4-af5a-445e-9670-6b0cd386d3f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:02.431968 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-163ac0f4-af5a-445e-9670-6b0cd386d3f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:02.438283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=86 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:02.447863 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-163ac0f4-af5a-445e-9670-6b0cd386d3f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:02.448721 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-163ac0f4-af5a-445e-9670-6b0cd386d3f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:02.450039 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-163ac0f4-af5a-445e-9670-6b0cd386d3f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:02.452401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-163ac0f4-af5a-445e-9670-6b0cd386d3f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:02.453549 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-163ac0f4-af5a-445e-9670-6b0cd386d3f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:02.454734 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-163ac0f4-af5a-445e-9670-6b0cd386d3f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:02.691663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-163ac0f4-af5a-445e-9670-6b0cd386d3f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:02.701346 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-163ac0f4-af5a-445e-9670-6b0cd386d3f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.279256 Aug 22 17:28:02.702066 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 98/203] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:02 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:03.740005 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-de279701-7973-4be9-8691-b1614b7cb02b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:03.741069 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-de279701-7973-4be9-8691-b1614b7cb02b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:03.750126 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de279701-7973-4be9-8691-b1614b7cb02b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:03.750959 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de279701-7973-4be9-8691-b1614b7cb02b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:03.751869 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de279701-7973-4be9-8691-b1614b7cb02b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:03.752757 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de279701-7973-4be9-8691-b1614b7cb02b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:03.753499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de279701-7973-4be9-8691-b1614b7cb02b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:03.754179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de279701-7973-4be9-8691-b1614b7cb02b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:04.022938 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-de279701-7973-4be9-8691-b1614b7cb02b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:04.030648 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:04.036957 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-de279701-7973-4be9-8691-b1614b7cb02b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.302710 Aug 22 17:28:04.038017 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 106/204] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:03 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:05.075680 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4bc91b3b-2e94-4f68-9897-98308549d090 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:05.077020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4bc91b3b-2e94-4f68-9897-98308549d090 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:05.089092 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4bc91b3b-2e94-4f68-9897-98308549d090 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:05.090203 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4bc91b3b-2e94-4f68-9897-98308549d090 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:05.091053 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4bc91b3b-2e94-4f68-9897-98308549d090 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:05.092430 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4bc91b3b-2e94-4f68-9897-98308549d090 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:05.093413 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4bc91b3b-2e94-4f68-9897-98308549d090 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:05.094208 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4bc91b3b-2e94-4f68-9897-98308549d090 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:05.477166 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4bc91b3b-2e94-4f68-9897-98308549d090 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:05.488321 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4bc91b3b-2e94-4f68-9897-98308549d090 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.417949 Aug 22 17:28:05.489651 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 99/205] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:05 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:06.524169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f2674a8d-9076-429f-a534-cf946f4aa4d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:06.525027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f2674a8d-9076-429f-a534-cf946f4aa4d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:06.541503 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f2674a8d-9076-429f-a534-cf946f4aa4d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:06.542388 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f2674a8d-9076-429f-a534-cf946f4aa4d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:06.543202 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f2674a8d-9076-429f-a534-cf946f4aa4d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:06.544409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f2674a8d-9076-429f-a534-cf946f4aa4d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:06.545236 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f2674a8d-9076-429f-a534-cf946f4aa4d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:06.546008 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f2674a8d-9076-429f-a534-cf946f4aa4d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:06.745251 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f2674a8d-9076-429f-a534-cf946f4aa4d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:06.754166 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f2674a8d-9076-429f-a534-cf946f4aa4d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.241956 Aug 22 17:28:06.755503 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 107/206] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:06 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:28:07.778512 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0383913f-4fe1-46fa-803d-26cefda1f0c8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:07.779250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0383913f-4fe1-46fa-803d-26cefda1f0c8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:07.786429 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0383913f-4fe1-46fa-803d-26cefda1f0c8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:07.786984 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0383913f-4fe1-46fa-803d-26cefda1f0c8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:07.787412 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0383913f-4fe1-46fa-803d-26cefda1f0c8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:07.788127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0383913f-4fe1-46fa-803d-26cefda1f0c8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:07.788629 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0383913f-4fe1-46fa-803d-26cefda1f0c8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:07.789056 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0383913f-4fe1-46fa-803d-26cefda1f0c8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:07.971759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0383913f-4fe1-46fa-803d-26cefda1f0c8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:07.982255 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0383913f-4fe1-46fa-803d-26cefda1f0c8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.208018 Aug 22 17:28:07.983334 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 100/207] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:07 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:09.009328 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-411a3509-2a78-48f4-bcde-0c679807de39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:09.016601 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-411a3509-2a78-48f4-bcde-0c679807de39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:09.028163 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-411a3509-2a78-48f4-bcde-0c679807de39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:09.029108 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-411a3509-2a78-48f4-bcde-0c679807de39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:09.030277 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-411a3509-2a78-48f4-bcde-0c679807de39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:09.032083 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-411a3509-2a78-48f4-bcde-0c679807de39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:09.033658 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-411a3509-2a78-48f4-bcde-0c679807de39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:09.034844 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-411a3509-2a78-48f4-bcde-0c679807de39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:09.230130 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-411a3509-2a78-48f4-bcde-0c679807de39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:09.241998 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-411a3509-2a78-48f4-bcde-0c679807de39 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.240067 Aug 22 17:28:09.242947 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 108/208] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:09 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:10.267456 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cb4de04e-80fb-4a24-9883-c9a2aff21b0f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:10.268793 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-cb4de04e-80fb-4a24-9883-c9a2aff21b0f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:10.275540 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb4de04e-80fb-4a24-9883-c9a2aff21b0f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:10.276054 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb4de04e-80fb-4a24-9883-c9a2aff21b0f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:10.276497 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb4de04e-80fb-4a24-9883-c9a2aff21b0f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:10.277215 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb4de04e-80fb-4a24-9883-c9a2aff21b0f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:10.277671 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb4de04e-80fb-4a24-9883-c9a2aff21b0f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:10.278096 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb4de04e-80fb-4a24-9883-c9a2aff21b0f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:10.573055 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-cb4de04e-80fb-4a24-9883-c9a2aff21b0f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:10.589264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-cb4de04e-80fb-4a24-9883-c9a2aff21b0f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.325502 Aug 22 17:28:10.602814 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 101/209] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:10 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:11.629151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5c6cc392-d55e-4208-aaa6-2c3d04ceea2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:11.629151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5c6cc392-d55e-4208-aaa6-2c3d04ceea2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:11.641022 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5c6cc392-d55e-4208-aaa6-2c3d04ceea2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:11.641823 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5c6cc392-d55e-4208-aaa6-2c3d04ceea2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:11.642582 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5c6cc392-d55e-4208-aaa6-2c3d04ceea2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:11.643906 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5c6cc392-d55e-4208-aaa6-2c3d04ceea2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:11.644529 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5c6cc392-d55e-4208-aaa6-2c3d04ceea2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:11.645804 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5c6cc392-d55e-4208-aaa6-2c3d04ceea2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:11.847335 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5c6cc392-d55e-4208-aaa6-2c3d04ceea2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:11.864470 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5c6cc392-d55e-4208-aaa6-2c3d04ceea2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.241418 Aug 22 17:28:11.865808 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 109/210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:11 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:12.892947 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2767af70-3333-4941-bd13-720af5face35 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:12.893865 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2767af70-3333-4941-bd13-720af5face35 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:12.901762 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2767af70-3333-4941-bd13-720af5face35 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:12.902462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2767af70-3333-4941-bd13-720af5face35 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:12.903084 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2767af70-3333-4941-bd13-720af5face35 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:12.903927 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2767af70-3333-4941-bd13-720af5face35 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:12.904589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2767af70-3333-4941-bd13-720af5face35 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:12.905125 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2767af70-3333-4941-bd13-720af5face35 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:13.170624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2767af70-3333-4941-bd13-720af5face35 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:13.179708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2767af70-3333-4941-bd13-720af5face35 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.293730 Aug 22 17:28:13.180311 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 102/211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:12 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:14.207376 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-07424f6d-92ff-45ff-88bc-349378715189 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:14.208434 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-07424f6d-92ff-45ff-88bc-349378715189 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:14.216229 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07424f6d-92ff-45ff-88bc-349378715189 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:14.216727 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07424f6d-92ff-45ff-88bc-349378715189 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:14.217161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07424f6d-92ff-45ff-88bc-349378715189 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:14.217954 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07424f6d-92ff-45ff-88bc-349378715189 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:14.218427 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07424f6d-92ff-45ff-88bc-349378715189 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:14.218886 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07424f6d-92ff-45ff-88bc-349378715189 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:14.423235 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-07424f6d-92ff-45ff-88bc-349378715189 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:14.432456 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-07424f6d-92ff-45ff-88bc-349378715189 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.229740 Aug 22 17:28:14.433062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 110/212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:14 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:14.906876 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a1eac182-f8f0-4634-a94c-c8878c7e2842 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:14.907737 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a1eac182-f8f0-4634-a94c-c8878c7e2842 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:14.914116 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a1eac182-f8f0-4634-a94c-c8878c7e2842 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:14.915163 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a1eac182-f8f0-4634-a94c-c8878c7e2842 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:14.915593 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a1eac182-f8f0-4634-a94c-c8878c7e2842 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:14.917077 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a1eac182-f8f0-4634-a94c-c8878c7e2842 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:14.917531 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a1eac182-f8f0-4634-a94c-c8878c7e2842 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:14.918116 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a1eac182-f8f0-4634-a94c-c8878c7e2842 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:14.949829 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a1eac182-f8f0-4634-a94c-c8878c7e2842 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Going to try to terminate instance {{(pid=121853) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:28:15.294474 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a1eac182-f8f0-4634-a94c-c8878c7e2842 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 204 len: 0 microversion: 2.1 time: 0.391527 Aug 22 17:28:15.295087 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 103/213] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:28:14 2022] DELETE /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:28:15.304255 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-116e0f37-ad6b-45b6-aa5a-e6101c89e804 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:15.304906 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-116e0f37-ad6b-45b6-aa5a-e6101c89e804 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:15.313263 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-116e0f37-ad6b-45b6-aa5a-e6101c89e804 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:15.317475 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-116e0f37-ad6b-45b6-aa5a-e6101c89e804 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:15.317475 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-116e0f37-ad6b-45b6-aa5a-e6101c89e804 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:15.317475 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-116e0f37-ad6b-45b6-aa5a-e6101c89e804 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:15.317475 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-116e0f37-ad6b-45b6-aa5a-e6101c89e804 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:15.318138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-116e0f37-ad6b-45b6-aa5a-e6101c89e804 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:15.461002 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-99ec276b-c1c2-4d0c-8af5-a31ac08b88f5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:15.461813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-99ec276b-c1c2-4d0c-8af5-a31ac08b88f5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:15.468869 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-99ec276b-c1c2-4d0c-8af5-a31ac08b88f5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:15.469375 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-99ec276b-c1c2-4d0c-8af5-a31ac08b88f5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:15.469808 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-99ec276b-c1c2-4d0c-8af5-a31ac08b88f5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:15.470537 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-99ec276b-c1c2-4d0c-8af5-a31ac08b88f5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:15.471356 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-99ec276b-c1c2-4d0c-8af5-a31ac08b88f5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:15.471464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-99ec276b-c1c2-4d0c-8af5-a31ac08b88f5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:15.480431 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-116e0f37-ad6b-45b6-aa5a-e6101c89e804 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:15.496900 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-116e0f37-ad6b-45b6-aa5a-e6101c89e804 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1554 microversion: 2.1 time: 0.197304 Aug 22 17:28:15.497509 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 111/214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:15 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:15.673702 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-99ec276b-c1c2-4d0c-8af5-a31ac08b88f5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:15.691799 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-99ec276b-c1c2-4d0c-8af5-a31ac08b88f5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.239270 Aug 22 17:28:15.693962 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 104/215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:15 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:28:16.530759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-46047a9c-61d8-4921-88e2-7d621aa82899 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:16.531929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-46047a9c-61d8-4921-88e2-7d621aa82899 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:16.545883 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-46047a9c-61d8-4921-88e2-7d621aa82899 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:16.548034 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-46047a9c-61d8-4921-88e2-7d621aa82899 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:16.548963 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-46047a9c-61d8-4921-88e2-7d621aa82899 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:16.550360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-46047a9c-61d8-4921-88e2-7d621aa82899 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:16.552058 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-46047a9c-61d8-4921-88e2-7d621aa82899 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:16.553057 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-46047a9c-61d8-4921-88e2-7d621aa82899 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:16.716422 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-72a95168-448c-414b-aba0-2133b3323050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:16.717820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-72a95168-448c-414b-aba0-2133b3323050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:16.728322 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-72a95168-448c-414b-aba0-2133b3323050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:16.728322 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-72a95168-448c-414b-aba0-2133b3323050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:16.729549 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-72a95168-448c-414b-aba0-2133b3323050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:16.731040 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-72a95168-448c-414b-aba0-2133b3323050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:16.731872 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-72a95168-448c-414b-aba0-2133b3323050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:16.732529 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-72a95168-448c-414b-aba0-2133b3323050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:16.813830 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-46047a9c-61d8-4921-88e2-7d621aa82899 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:16.828600 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-46047a9c-61d8-4921-88e2-7d621aa82899 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1554 microversion: 2.1 time: 0.305645 Aug 22 17:28:16.829436 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 112/216] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:16 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1554 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:16.934618 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-72a95168-448c-414b-aba0-2133b3323050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:16.951425 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-72a95168-448c-414b-aba0-2133b3323050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.239314 Aug 22 17:28:16.952349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 105/217] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:16 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:17.870033 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-812e0e66-8002-4ddf-b53a-32bc6db156e9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:17.874053 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-812e0e66-8002-4ddf-b53a-32bc6db156e9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:17.882569 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-812e0e66-8002-4ddf-b53a-32bc6db156e9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:17.883597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-812e0e66-8002-4ddf-b53a-32bc6db156e9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:17.884220 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-812e0e66-8002-4ddf-b53a-32bc6db156e9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:17.885504 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-812e0e66-8002-4ddf-b53a-32bc6db156e9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:17.886562 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-812e0e66-8002-4ddf-b53a-32bc6db156e9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:17.887637 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-812e0e66-8002-4ddf-b53a-32bc6db156e9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:17.996097 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b73d0668-3165-42fe-ba17-64b272c270a0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:18.000251 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b73d0668-3165-42fe-ba17-64b272c270a0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:18.008697 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b73d0668-3165-42fe-ba17-64b272c270a0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:18.009524 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b73d0668-3165-42fe-ba17-64b272c270a0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:18.010284 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b73d0668-3165-42fe-ba17-64b272c270a0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:18.011541 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b73d0668-3165-42fe-ba17-64b272c270a0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:18.012372 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b73d0668-3165-42fe-ba17-64b272c270a0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:18.013118 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b73d0668-3165-42fe-ba17-64b272c270a0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:18.101805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-812e0e66-8002-4ddf-b53a-32bc6db156e9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:18.110964 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-812e0e66-8002-4ddf-b53a-32bc6db156e9 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1554 microversion: 2.1 time: 0.248151 Aug 22 17:28:18.114541 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 113/218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:17 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1554 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:18.318435 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b73d0668-3165-42fe-ba17-64b272c270a0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:18.330448 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b73d0668-3165-42fe-ba17-64b272c270a0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.345032 Aug 22 17:28:18.331352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 106/219] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:17 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:28:19.151077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-da3bc0c3-0913-4c2a-b261-657ca82f4578 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:19.151773 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-da3bc0c3-0913-4c2a-b261-657ca82f4578 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:19.154113 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=44 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:19.159149 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da3bc0c3-0913-4c2a-b261-657ca82f4578 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:19.159644 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da3bc0c3-0913-4c2a-b261-657ca82f4578 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:19.160109 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da3bc0c3-0913-4c2a-b261-657ca82f4578 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:19.161182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da3bc0c3-0913-4c2a-b261-657ca82f4578 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:19.161801 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da3bc0c3-0913-4c2a-b261-657ca82f4578 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:19.162225 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da3bc0c3-0913-4c2a-b261-657ca82f4578 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:19.364765 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-62fa9594-6019-4252-bc1b-5d029b9069d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:19.366046 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-62fa9594-6019-4252-bc1b-5d029b9069d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:19.377399 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-62fa9594-6019-4252-bc1b-5d029b9069d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:19.379419 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-62fa9594-6019-4252-bc1b-5d029b9069d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:19.380190 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-62fa9594-6019-4252-bc1b-5d029b9069d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:19.381249 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-62fa9594-6019-4252-bc1b-5d029b9069d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:19.381615 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-da3bc0c3-0913-4c2a-b261-657ca82f4578 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:19.398206 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-62fa9594-6019-4252-bc1b-5d029b9069d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:19.398206 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-62fa9594-6019-4252-bc1b-5d029b9069d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:19.398852 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-da3bc0c3-0913-4c2a-b261-657ca82f4578 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1554 microversion: 2.1 time: 0.250507 Aug 22 17:28:19.410826 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 114/220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:19 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1554 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:19.586277 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-62fa9594-6019-4252-bc1b-5d029b9069d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:19.596425 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-62fa9594-6019-4252-bc1b-5d029b9069d8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.238236 Aug 22 17:28:19.597140 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 107/221] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:19 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:20.436477 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c3bca45f-1e1b-4119-b0f6-1c0649acd185 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:20.437138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c3bca45f-1e1b-4119-b0f6-1c0649acd185 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:20.444576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c3bca45f-1e1b-4119-b0f6-1c0649acd185 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:20.445061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c3bca45f-1e1b-4119-b0f6-1c0649acd185 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:20.445492 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c3bca45f-1e1b-4119-b0f6-1c0649acd185 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:20.446271 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c3bca45f-1e1b-4119-b0f6-1c0649acd185 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:20.446753 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c3bca45f-1e1b-4119-b0f6-1c0649acd185 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:20.447171 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c3bca45f-1e1b-4119-b0f6-1c0649acd185 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:20.622803 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-fc20420b-41f0-4388-8991-c3cb1ee3fba1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:20.623654 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-fc20420b-41f0-4388-8991-c3cb1ee3fba1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:20.633033 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc20420b-41f0-4388-8991-c3cb1ee3fba1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:20.633577 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc20420b-41f0-4388-8991-c3cb1ee3fba1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:20.634066 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc20420b-41f0-4388-8991-c3cb1ee3fba1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:20.635245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc20420b-41f0-4388-8991-c3cb1ee3fba1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:20.635817 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc20420b-41f0-4388-8991-c3cb1ee3fba1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:20.636345 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc20420b-41f0-4388-8991-c3cb1ee3fba1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:20.655202 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c3bca45f-1e1b-4119-b0f6-1c0649acd185 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:20.666595 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c3bca45f-1e1b-4119-b0f6-1c0649acd185 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1554 microversion: 2.1 time: 0.234613 Aug 22 17:28:20.667454 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 115/222] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:20 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1554 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:20.792583 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-fc20420b-41f0-4388-8991-c3cb1ee3fba1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:20.807227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-fc20420b-41f0-4388-8991-c3cb1ee3fba1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.190045 Aug 22 17:28:20.808264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 108/223] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:20 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:28:21.701311 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-7cac89f7-9657-4263-a551-2a0026af3f5f tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:21.701948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-7cac89f7-9657-4263-a551-2a0026af3f5f tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:21.709829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7cac89f7-9657-4263-a551-2a0026af3f5f tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:21.710416 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7cac89f7-9657-4263-a551-2a0026af3f5f tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:21.710958 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7cac89f7-9657-4263-a551-2a0026af3f5f tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:21.711712 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7cac89f7-9657-4263-a551-2a0026af3f5f tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:21.712204 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7cac89f7-9657-4263-a551-2a0026af3f5f tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:21.712667 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7cac89f7-9657-4263-a551-2a0026af3f5f tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:21.844104 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-138cc4b0-799c-460a-9fda-1a004b7704db tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:21.847330 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-138cc4b0-799c-460a-9fda-1a004b7704db tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:21.855022 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-138cc4b0-799c-460a-9fda-1a004b7704db tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:21.856304 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-138cc4b0-799c-460a-9fda-1a004b7704db tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:21.857265 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-138cc4b0-799c-460a-9fda-1a004b7704db tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:21.858832 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-138cc4b0-799c-460a-9fda-1a004b7704db tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:21.859836 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-138cc4b0-799c-460a-9fda-1a004b7704db tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:21.860850 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-138cc4b0-799c-460a-9fda-1a004b7704db tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:21.878419 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-7cac89f7-9657-4263-a551-2a0026af3f5f tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:21.889392 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-7cac89f7-9657-4263-a551-2a0026af3f5f tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1554 microversion: 2.1 time: 0.191944 Aug 22 17:28:21.890260 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 116/224] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:21 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1554 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:22.033909 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-138cc4b0-799c-460a-9fda-1a004b7704db tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:22.043928 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-138cc4b0-799c-460a-9fda-1a004b7704db tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.207048 Aug 22 17:28:22.044598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 109/225] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:21 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:22.912021 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-87217b90-10f6-4595-80d1-1f063d5142f5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:22.912647 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-87217b90-10f6-4595-80d1-1f063d5142f5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:22.919599 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87217b90-10f6-4595-80d1-1f063d5142f5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:22.920120 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87217b90-10f6-4595-80d1-1f063d5142f5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:22.920560 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87217b90-10f6-4595-80d1-1f063d5142f5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:22.921276 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87217b90-10f6-4595-80d1-1f063d5142f5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:22.921729 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87217b90-10f6-4595-80d1-1f063d5142f5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:22.922154 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87217b90-10f6-4595-80d1-1f063d5142f5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:23.067041 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2c26eb91-dff9-4a25-9825-c9b209acd718 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:23.068084 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2c26eb91-dff9-4a25-9825-c9b209acd718 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:23.077085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c26eb91-dff9-4a25-9825-c9b209acd718 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:23.077781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c26eb91-dff9-4a25-9825-c9b209acd718 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:23.078823 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c26eb91-dff9-4a25-9825-c9b209acd718 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:23.079971 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c26eb91-dff9-4a25-9825-c9b209acd718 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:23.080878 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c26eb91-dff9-4a25-9825-c9b209acd718 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:23.081443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c26eb91-dff9-4a25-9825-c9b209acd718 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:23.092709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-87217b90-10f6-4595-80d1-1f063d5142f5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:23.117014 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-87217b90-10f6-4595-80d1-1f063d5142f5 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1554 microversion: 2.1 time: 0.208608 Aug 22 17:28:23.118151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 117/226] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:22 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1554 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:23.317761 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2c26eb91-dff9-4a25-9825-c9b209acd718 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:23.326585 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2c26eb91-dff9-4a25-9825-c9b209acd718 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.264253 Aug 22 17:28:23.327178 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 110/227] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:23 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:24.154065 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4d083b4c-4b01-414a-bf3f-689943421506 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:24.154714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4d083b4c-4b01-414a-bf3f-689943421506 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:24.162107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4d083b4c-4b01-414a-bf3f-689943421506 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:24.162634 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4d083b4c-4b01-414a-bf3f-689943421506 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:24.163091 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4d083b4c-4b01-414a-bf3f-689943421506 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:24.163809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4d083b4c-4b01-414a-bf3f-689943421506 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:24.164267 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4d083b4c-4b01-414a-bf3f-689943421506 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:24.164696 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4d083b4c-4b01-414a-bf3f-689943421506 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:24.316771 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4d083b4c-4b01-414a-bf3f-689943421506 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:24.326705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4d083b4c-4b01-414a-bf3f-689943421506 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1554 microversion: 2.1 time: 0.176862 Aug 22 17:28:24.327474 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 118/228] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:24 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:24.353683 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5318efb4-7657-4375-b0ae-5b4e0eb42452 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:24.354853 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5318efb4-7657-4375-b0ae-5b4e0eb42452 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:24.365733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5318efb4-7657-4375-b0ae-5b4e0eb42452 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:24.366501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5318efb4-7657-4375-b0ae-5b4e0eb42452 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:24.367212 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5318efb4-7657-4375-b0ae-5b4e0eb42452 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:24.368376 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5318efb4-7657-4375-b0ae-5b4e0eb42452 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:24.369134 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5318efb4-7657-4375-b0ae-5b4e0eb42452 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:24.369859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5318efb4-7657-4375-b0ae-5b4e0eb42452 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:24.548266 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5318efb4-7657-4375-b0ae-5b4e0eb42452 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:24.563316 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5318efb4-7657-4375-b0ae-5b4e0eb42452 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.214944 Aug 22 17:28:24.564581 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 111/229] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:24 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:25.353699 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0bcb1cca-05f3-4809-8ff4-6ed3ef911110 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:25.354996 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0bcb1cca-05f3-4809-8ff4-6ed3ef911110 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:25.363108 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bcb1cca-05f3-4809-8ff4-6ed3ef911110 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:25.365889 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bcb1cca-05f3-4809-8ff4-6ed3ef911110 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:25.365889 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bcb1cca-05f3-4809-8ff4-6ed3ef911110 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:25.365889 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bcb1cca-05f3-4809-8ff4-6ed3ef911110 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:25.366392 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bcb1cca-05f3-4809-8ff4-6ed3ef911110 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:25.366981 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bcb1cca-05f3-4809-8ff4-6ed3ef911110 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:25.528961 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0bcb1cca-05f3-4809-8ff4-6ed3ef911110 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:25.545119 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0bcb1cca-05f3-4809-8ff4-6ed3ef911110 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1554 microversion: 2.1 time: 0.198315 Aug 22 17:28:25.546129 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 119/230] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:25 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:25.590694 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-54a6a659-b344-4784-9da0-58516f13eba7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:25.591827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-54a6a659-b344-4784-9da0-58516f13eba7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:25.606360 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-54a6a659-b344-4784-9da0-58516f13eba7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:25.606360 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-54a6a659-b344-4784-9da0-58516f13eba7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:25.606360 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-54a6a659-b344-4784-9da0-58516f13eba7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:25.607447 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-54a6a659-b344-4784-9da0-58516f13eba7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:25.608288 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-54a6a659-b344-4784-9da0-58516f13eba7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:25.609040 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-54a6a659-b344-4784-9da0-58516f13eba7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:25.802254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-54a6a659-b344-4784-9da0-58516f13eba7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:25.810826 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:25.811708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-54a6a659-b344-4784-9da0-58516f13eba7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.228793 Aug 22 17:28:25.812299 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 112/231] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:25 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:26.581093 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6f7bf4c0-deca-48cc-b2be-ebd18a0fb292 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:26.581730 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6f7bf4c0-deca-48cc-b2be-ebd18a0fb292 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:26.589301 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6f7bf4c0-deca-48cc-b2be-ebd18a0fb292 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:26.589799 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6f7bf4c0-deca-48cc-b2be-ebd18a0fb292 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:26.590239 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6f7bf4c0-deca-48cc-b2be-ebd18a0fb292 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:26.590986 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6f7bf4c0-deca-48cc-b2be-ebd18a0fb292 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:26.591444 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6f7bf4c0-deca-48cc-b2be-ebd18a0fb292 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:26.591872 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6f7bf4c0-deca-48cc-b2be-ebd18a0fb292 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:26.762920 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6f7bf4c0-deca-48cc-b2be-ebd18a0fb292 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:26.774851 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6f7bf4c0-deca-48cc-b2be-ebd18a0fb292 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1554 microversion: 2.1 time: 0.197340 Aug 22 17:28:26.778356 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 120/232] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:26 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1554 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:26.835750 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c543bb50-5cf3-4b97-933e-e33469bb7f04 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:26.836774 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c543bb50-5cf3-4b97-933e-e33469bb7f04 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:26.846748 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c543bb50-5cf3-4b97-933e-e33469bb7f04 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:26.847239 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c543bb50-5cf3-4b97-933e-e33469bb7f04 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:26.848302 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c543bb50-5cf3-4b97-933e-e33469bb7f04 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:26.849429 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c543bb50-5cf3-4b97-933e-e33469bb7f04 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:26.849632 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c543bb50-5cf3-4b97-933e-e33469bb7f04 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:26.850097 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c543bb50-5cf3-4b97-933e-e33469bb7f04 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:27.029330 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c543bb50-5cf3-4b97-933e-e33469bb7f04 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:27.037972 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c543bb50-5cf3-4b97-933e-e33469bb7f04 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.209183 Aug 22 17:28:27.038599 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 113/233] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:26 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:27.807053 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9bfb7a75-6050-4423-a92c-938cffe5daf0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:27.807603 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9bfb7a75-6050-4423-a92c-938cffe5daf0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:27.815873 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9bfb7a75-6050-4423-a92c-938cffe5daf0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:27.817205 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9bfb7a75-6050-4423-a92c-938cffe5daf0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:27.818067 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9bfb7a75-6050-4423-a92c-938cffe5daf0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:27.818962 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9bfb7a75-6050-4423-a92c-938cffe5daf0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:27.819740 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9bfb7a75-6050-4423-a92c-938cffe5daf0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:27.820226 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9bfb7a75-6050-4423-a92c-938cffe5daf0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:28.005484 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9bfb7a75-6050-4423-a92c-938cffe5daf0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:28.014948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9bfb7a75-6050-4423-a92c-938cffe5daf0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1554 microversion: 2.1 time: 0.211838 Aug 22 17:28:28.015552 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 121/234] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:27 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1554 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:28.059160 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-62857e20-3a01-44a8-a795-085496e777ac tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:28.059782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-62857e20-3a01-44a8-a795-085496e777ac tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:28.066206 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-62857e20-3a01-44a8-a795-085496e777ac tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:28.067617 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-62857e20-3a01-44a8-a795-085496e777ac tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:28.068240 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-62857e20-3a01-44a8-a795-085496e777ac tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:28.068962 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-62857e20-3a01-44a8-a795-085496e777ac tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:28.069412 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-62857e20-3a01-44a8-a795-085496e777ac tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:28.069833 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-62857e20-3a01-44a8-a795-085496e777ac tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:28.228831 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-62857e20-3a01-44a8-a795-085496e777ac tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:28.237238 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-62857e20-3a01-44a8-a795-085496e777ac tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.181938 Aug 22 17:28:28.237836 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 114/235] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:28 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:29.038362 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5421ed2d-0ffe-472d-85b0-a85525d19ff6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:29.039105 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5421ed2d-0ffe-472d-85b0-a85525d19ff6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:29.045922 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5421ed2d-0ffe-472d-85b0-a85525d19ff6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:29.046414 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5421ed2d-0ffe-472d-85b0-a85525d19ff6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:29.046877 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5421ed2d-0ffe-472d-85b0-a85525d19ff6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:29.047594 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5421ed2d-0ffe-472d-85b0-a85525d19ff6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:29.048074 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5421ed2d-0ffe-472d-85b0-a85525d19ff6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:29.048497 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5421ed2d-0ffe-472d-85b0-a85525d19ff6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:29.191100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5421ed2d-0ffe-472d-85b0-a85525d19ff6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:29.200418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5421ed2d-0ffe-472d-85b0-a85525d19ff6 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1554 microversion: 2.1 time: 0.166857 Aug 22 17:28:29.201021 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 122/236] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:29 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:29.260535 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c4f09fa2-bf25-4cb2-b283-3fb83af4d06d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:29.261788 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c4f09fa2-bf25-4cb2-b283-3fb83af4d06d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:29.269237 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c4f09fa2-bf25-4cb2-b283-3fb83af4d06d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:29.269824 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c4f09fa2-bf25-4cb2-b283-3fb83af4d06d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:29.270268 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c4f09fa2-bf25-4cb2-b283-3fb83af4d06d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:29.271031 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c4f09fa2-bf25-4cb2-b283-3fb83af4d06d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:29.271496 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c4f09fa2-bf25-4cb2-b283-3fb83af4d06d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:29.271918 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c4f09fa2-bf25-4cb2-b283-3fb83af4d06d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:29.421919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c4f09fa2-bf25-4cb2-b283-3fb83af4d06d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:29.430383 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c4f09fa2-bf25-4cb2-b283-3fb83af4d06d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.173919 Aug 22 17:28:29.431006 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 115/237] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:29 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:28:30.224397 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-de683b06-8555-4123-8058-494cf0b330e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:30.232476 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-de683b06-8555-4123-8058-494cf0b330e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:30.234552 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de683b06-8555-4123-8058-494cf0b330e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:30.235231 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de683b06-8555-4123-8058-494cf0b330e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:30.235808 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de683b06-8555-4123-8058-494cf0b330e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:30.236685 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de683b06-8555-4123-8058-494cf0b330e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:30.237451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de683b06-8555-4123-8058-494cf0b330e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:30.237998 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de683b06-8555-4123-8058-494cf0b330e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:30.262022 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=100 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:30.399428 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-de683b06-8555-4123-8058-494cf0b330e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:30.408739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-de683b06-8555-4123-8058-494cf0b330e4 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1554 microversion: 2.1 time: 0.189021 Aug 22 17:28:30.409346 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 123/238] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:30 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1554 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:28:30.453127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a4809fec-67a3-4c3a-a65a-64a32885ffc8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:30.454454 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a4809fec-67a3-4c3a-a65a-64a32885ffc8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:30.462258 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a4809fec-67a3-4c3a-a65a-64a32885ffc8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:30.462725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a4809fec-67a3-4c3a-a65a-64a32885ffc8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:30.463300 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a4809fec-67a3-4c3a-a65a-64a32885ffc8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:30.464011 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a4809fec-67a3-4c3a-a65a-64a32885ffc8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:30.464482 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a4809fec-67a3-4c3a-a65a-64a32885ffc8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:30.464908 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a4809fec-67a3-4c3a-a65a-64a32885ffc8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:30.674168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a4809fec-67a3-4c3a-a65a-64a32885ffc8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:30.683157 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a4809fec-67a3-4c3a-a65a-64a32885ffc8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.234478 Aug 22 17:28:30.683818 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 116/239] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:30 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:30.869108 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-5dfd2816-8ef4-4267-845e-9fc1f4ac9d64 req-835c0446-7cbd-4574-b0da-97527e5e29d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb123a58-2326-45c2-8c47-e297dd1d60c2", "name": "network-vif-unplugged", "status": "completed", "tag": "d2251451-3cf4-4bc2-94f0-b88d3e3158ae"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:28:30.891951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-5dfd2816-8ef4-4267-845e-9fc1f4ac9d64 req-835c0446-7cbd-4574-b0da-97527e5e29d8 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:30.894408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-5dfd2816-8ef4-4267-845e-9fc1f4ac9d64 req-835c0446-7cbd-4574-b0da-97527e5e29d8 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:30.896262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-5dfd2816-8ef4-4267-845e-9fc1f4ac9d64 req-835c0446-7cbd-4574-b0da-97527e5e29d8 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:30.919382 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-5dfd2816-8ef4-4267-845e-9fc1f4ac9d64 req-835c0446-7cbd-4574-b0da-97527e5e29d8 service nova] Creating event network-vif-unplugged:d2251451-3cf4-4bc2-94f0-b88d3e3158ae for instance eb123a58-2326-45c2-8c47-e297dd1d60c2 on hv-cinder-85394 Aug 22 17:28:30.932426 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-5dfd2816-8ef4-4267-845e-9fc1f4ac9d64 req-835c0446-7cbd-4574-b0da-97527e5e29d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074584 Aug 22 17:28:30.933057 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 124/240] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:28:31.449263 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f0299311-a446-465a-b099-05f5d619c022 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:31.450089 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f0299311-a446-465a-b099-05f5d619c022 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:31.456306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f0299311-a446-465a-b099-05f5d619c022 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:31.457025 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f0299311-a446-465a-b099-05f5d619c022 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:31.457556 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f0299311-a446-465a-b099-05f5d619c022 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:31.458306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f0299311-a446-465a-b099-05f5d619c022 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:31.458757 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f0299311-a446-465a-b099-05f5d619c022 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:31.459177 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f0299311-a446-465a-b099-05f5d619c022 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:31.706392 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e818f1f7-b095-4123-82a5-026562ce27e0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:31.707846 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e818f1f7-b095-4123-82a5-026562ce27e0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:31.715638 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e818f1f7-b095-4123-82a5-026562ce27e0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:31.716211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e818f1f7-b095-4123-82a5-026562ce27e0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:31.716866 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e818f1f7-b095-4123-82a5-026562ce27e0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:31.717604 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e818f1f7-b095-4123-82a5-026562ce27e0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:31.718074 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e818f1f7-b095-4123-82a5-026562ce27e0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:31.718550 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e818f1f7-b095-4123-82a5-026562ce27e0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:31.740961 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f0299311-a446-465a-b099-05f5d619c022 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:31.754853 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f0299311-a446-465a-b099-05f5d619c022 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1554 microversion: 2.1 time: 0.313767 Aug 22 17:28:31.755840 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 117/241] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:31 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1554 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:31.906432 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e818f1f7-b095-4123-82a5-026562ce27e0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:31.920520 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e818f1f7-b095-4123-82a5-026562ce27e0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.218180 Aug 22 17:28:31.936374 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 125/242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:31 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:28:32.078605 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-9837637d-7af5-4b95-bebf-824c55128d4b req-6ca0c529-6baf-49a1-86ff-0c066556968a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb123a58-2326-45c2-8c47-e297dd1d60c2", "name": "network-vif-deleted", "tag": "d2251451-3cf4-4bc2-94f0-b88d3e3158ae"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:28:32.098519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-9837637d-7af5-4b95-bebf-824c55128d4b req-6ca0c529-6baf-49a1-86ff-0c066556968a service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:32.099672 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-9837637d-7af5-4b95-bebf-824c55128d4b req-6ca0c529-6baf-49a1-86ff-0c066556968a service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:32.100411 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-9837637d-7af5-4b95-bebf-824c55128d4b req-6ca0c529-6baf-49a1-86ff-0c066556968a service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:32.128280 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-9837637d-7af5-4b95-bebf-824c55128d4b req-6ca0c529-6baf-49a1-86ff-0c066556968a service nova] Creating event network-vif-deleted:d2251451-3cf4-4bc2-94f0-b88d3e3158ae for instance eb123a58-2326-45c2-8c47-e297dd1d60c2 on hv-cinder-85394 Aug 22 17:28:32.133786 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-9837637d-7af5-4b95-bebf-824c55128d4b req-6ca0c529-6baf-49a1-86ff-0c066556968a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061998 Aug 22 17:28:32.134761 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 118/243] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:28:32.779266 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-55c08cd3-f948-496d-9a56-75b567bffe53 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:32.780084 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-55c08cd3-f948-496d-9a56-75b567bffe53 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:32.802367 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-55c08cd3-f948-496d-9a56-75b567bffe53 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:32.802860 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-55c08cd3-f948-496d-9a56-75b567bffe53 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:32.803326 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-55c08cd3-f948-496d-9a56-75b567bffe53 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:32.804054 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-55c08cd3-f948-496d-9a56-75b567bffe53 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:32.805794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-55c08cd3-f948-496d-9a56-75b567bffe53 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:32.806315 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-55c08cd3-f948-496d-9a56-75b567bffe53 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:32.913023 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-55c08cd3-f948-496d-9a56-75b567bffe53 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:32.928357 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-55c08cd3-f948-496d-9a56-75b567bffe53 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1345 microversion: 2.1 time: 0.153741 Aug 22 17:28:32.929020 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 126/244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:32 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:28:32.965455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-01e958be-d19a-40d9-b9bd-ea23eb13917b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:32.966617 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-01e958be-d19a-40d9-b9bd-ea23eb13917b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:32.968923 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:32.984775 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-01e958be-d19a-40d9-b9bd-ea23eb13917b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:32.985615 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-01e958be-d19a-40d9-b9bd-ea23eb13917b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:32.986580 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-01e958be-d19a-40d9-b9bd-ea23eb13917b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:32.988410 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-01e958be-d19a-40d9-b9bd-ea23eb13917b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:32.989469 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-01e958be-d19a-40d9-b9bd-ea23eb13917b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:32.990179 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-01e958be-d19a-40d9-b9bd-ea23eb13917b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:33.184431 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-01e958be-d19a-40d9-b9bd-ea23eb13917b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:33.194221 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-01e958be-d19a-40d9-b9bd-ea23eb13917b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.233654 Aug 22 17:28:33.195093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 119/245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:32 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:33.955441 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0e1a5203-928b-4555-bd19-1d3130a218c3 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:33.956162 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0e1a5203-928b-4555-bd19-1d3130a218c3 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:33.964402 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e1a5203-928b-4555-bd19-1d3130a218c3 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:33.964891 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e1a5203-928b-4555-bd19-1d3130a218c3 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:33.965326 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e1a5203-928b-4555-bd19-1d3130a218c3 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:33.966081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e1a5203-928b-4555-bd19-1d3130a218c3 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:33.966565 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e1a5203-928b-4555-bd19-1d3130a218c3 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:33.966992 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e1a5203-928b-4555-bd19-1d3130a218c3 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:34.021247 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e1a5203-928b-4555-bd19-1d3130a218c3 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:34.022078 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e1a5203-928b-4555-bd19-1d3130a218c3 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:34.023092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e1a5203-928b-4555-bd19-1d3130a218c3 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:34.023666 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-0e1a5203-928b-4555-bd19-1d3130a218c3 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lazy-loading 'fault' on Instance uuid eb123a58-2326-45c2-8c47-e297dd1d60c2 {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:28:34.084899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0e1a5203-928b-4555-bd19-1d3130a218c3 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9eedc633493b478a9009f7bce07696a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '778299a985204da18b35d86ed8c4c77d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:34.095952 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0e1a5203-928b-4555-bd19-1d3130a218c3 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 200 len: 1304 microversion: 2.1 time: 0.145798 Aug 22 17:28:34.103097 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 127/246] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:33 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:28:34.221501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-9e8a16d8-7c34-478f-95db-7aa9626fd4b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:34.222077 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9e8a16d8-7c34-478f-95db-7aa9626fd4b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:34.228772 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9e8a16d8-7c34-478f-95db-7aa9626fd4b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:34.229255 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9e8a16d8-7c34-478f-95db-7aa9626fd4b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:34.229692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9e8a16d8-7c34-478f-95db-7aa9626fd4b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:34.230390 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9e8a16d8-7c34-478f-95db-7aa9626fd4b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:34.230870 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9e8a16d8-7c34-478f-95db-7aa9626fd4b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:34.231293 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9e8a16d8-7c34-478f-95db-7aa9626fd4b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:34.420831 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-9e8a16d8-7c34-478f-95db-7aa9626fd4b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:34.430322 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-9e8a16d8-7c34-478f-95db-7aa9626fd4b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.212838 Aug 22 17:28:34.431909 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 120/247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:34 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:35.129817 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-35a3c1bf-1570-4391-95e0-57ebf5fc5128 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:35.130555 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-35a3c1bf-1570-4391-95e0-57ebf5fc5128 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:35.140953 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-35a3c1bf-1570-4391-95e0-57ebf5fc5128 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:35.141820 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-35a3c1bf-1570-4391-95e0-57ebf5fc5128 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:35.147001 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-35a3c1bf-1570-4391-95e0-57ebf5fc5128 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:35.147001 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-35a3c1bf-1570-4391-95e0-57ebf5fc5128 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:35.147001 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-35a3c1bf-1570-4391-95e0-57ebf5fc5128 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:35.147001 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-35a3c1bf-1570-4391-95e0-57ebf5fc5128 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:35.169029 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-35a3c1bf-1570-4391-95e0-57ebf5fc5128 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] HTTP exception thrown: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-35a3c1bf-1570-4391-95e0-57ebf5fc5128 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Request method failure captured: Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 HTTP/1.1 Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xa-IZzl4aVgbxN9aTu6MNYBc0D6ApkDZkyNYFwDrFrp0iybkcWTCZ8OBVm_KLB5aHqguKsPbxgeAgDCxZ9rpxEeG2zdWExJQkD_lh4mqmtFnDVe02m8c-p6w9mUqk70CaKQcfSfmAgqvbfKZbrQppmC1M2OEIENnKeojYVaUjhcVU Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 778299a985204da18b35d86ed8c4c77d Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-DeleteServersTestJSON-393195605 Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:28:35.174148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:28:35.178200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/778299a985204da18b35d86ed8c4c77d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/778299a985204da18b35d86ed8c4c77d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/778299a985204da18b35d86ed8c4c77d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_778299a985204da18b35d86ed8c4c77d", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:28:35.178200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-DeleteServersTestJSON-393195605 Aug 22 17:28:35.178200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 778299a985204da18b35d86ed8c4c77d Aug 22 17:28:35.178200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-DeleteServersTestJSON-393195605 Aug 22 17:28:35.178200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-DeleteServersTestJSON-393195605-project Aug 22 17:28:35.178200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:28:35.178200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:28:35.178200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 9eedc633493b478a9009f7bce07696a8 Aug 22 17:28:35.178200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-DeleteServersTestJSON-393195605-project Aug 22 17:28:35.178200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:28:35.178200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:35.178200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': 'eb123a58-2326-45c2-8c47-e297dd1d60c2'} Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:28:35.179759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:35.181993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:28:35.184369 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-35a3c1bf-1570-4391-95e0-57ebf5fc5128 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Returning 404 to user: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:28:35.184369 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-35a3c1bf-1570-4391-95e0-57ebf5fc5128 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 404 len: 111 microversion: 2.1 time: 0.055469 Aug 22 17:28:35.184369 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 128/248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:35 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:28:35.344070 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d70968b5-6416-4eca-b73e-0e0b30a156ec tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:35.346395 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d70968b5-6416-4eca-b73e-0e0b30a156ec tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:35.354907 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d70968b5-6416-4eca-b73e-0e0b30a156ec tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:35.355498 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d70968b5-6416-4eca-b73e-0e0b30a156ec tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:35.356002 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d70968b5-6416-4eca-b73e-0e0b30a156ec tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:35.356823 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d70968b5-6416-4eca-b73e-0e0b30a156ec tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:35.357522 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d70968b5-6416-4eca-b73e-0e0b30a156ec tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:35.358748 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d70968b5-6416-4eca-b73e-0e0b30a156ec tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:35.387883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-d70968b5-6416-4eca-b73e-0e0b30a156ec tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] HTTP exception thrown: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d70968b5-6416-4eca-b73e-0e0b30a156ec tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Request method failure captured: Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2/os-volume_attachments HTTP/1.1 Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA7xa-IZzl4aVgbxN9aTu6MNYBc0D6ApkDZkyNYFwDrFrp0iybkcWTCZ8OBVm_KLB5aHqguKsPbxgeAgDCxZ9rpxEeG2zdWExJQkD_lh4mqmtFnDVe02m8c-p6w9mUqk70CaKQcfSfmAgqvbfKZbrQppmC1M2OEIENnKeojYVaUjhcVU Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 778299a985204da18b35d86ed8c4c77d Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-DeleteServersTestJSON-393195605 Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:28:35.396377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:28:35.398883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/778299a985204da18b35d86ed8c4c77d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/778299a985204da18b35d86ed8c4c77d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/778299a985204da18b35d86ed8c4c77d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_778299a985204da18b35d86ed8c4c77d", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:28:35.398883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-DeleteServersTestJSON-393195605 Aug 22 17:28:35.398883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 778299a985204da18b35d86ed8c4c77d Aug 22 17:28:35.398883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-DeleteServersTestJSON-393195605 Aug 22 17:28:35.398883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-DeleteServersTestJSON-393195605-project Aug 22 17:28:35.398883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:28:35.398883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:28:35.398883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: 9eedc633493b478a9009f7bce07696a8 Aug 22 17:28:35.398883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-DeleteServersTestJSON-393195605-project Aug 22 17:28:35.398883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:28:35.398883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:35.398883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'server_id': 'eb123a58-2326-45c2-8c47-e297dd1d60c2'} Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:28:35.400519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:35.402827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:35.407162 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d70968b5-6416-4eca-b73e-0e0b30a156ec tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Returning 404 to user: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:28:35.407162 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d70968b5-6416-4eca-b73e-0e0b30a156ec tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059511 Aug 22 17:28:35.407162 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 121/249] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:28:35 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2/os-volume_attachments => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:28:35.457649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-1f724712-da5f-4aca-9f5f-38d3510a9ae1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:35.459455 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-1f724712-da5f-4aca-9f5f-38d3510a9ae1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:35.471178 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1f724712-da5f-4aca-9f5f-38d3510a9ae1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:35.472068 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1f724712-da5f-4aca-9f5f-38d3510a9ae1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:35.472990 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1f724712-da5f-4aca-9f5f-38d3510a9ae1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:35.474364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1f724712-da5f-4aca-9f5f-38d3510a9ae1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:35.475216 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1f724712-da5f-4aca-9f5f-38d3510a9ae1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:35.486516 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1f724712-da5f-4aca-9f5f-38d3510a9ae1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:35.729927 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-1f724712-da5f-4aca-9f5f-38d3510a9ae1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:35.741976 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-1f724712-da5f-4aca-9f5f-38d3510a9ae1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.292255 Aug 22 17:28:35.742772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 129/250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:35 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:36.771271 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-28e75926-a83d-4666-b0f5-2b5180aa941a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:36.772591 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-28e75926-a83d-4666-b0f5-2b5180aa941a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:36.780874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28e75926-a83d-4666-b0f5-2b5180aa941a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:36.781529 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28e75926-a83d-4666-b0f5-2b5180aa941a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:36.782090 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28e75926-a83d-4666-b0f5-2b5180aa941a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:36.783153 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28e75926-a83d-4666-b0f5-2b5180aa941a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:36.783831 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28e75926-a83d-4666-b0f5-2b5180aa941a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:36.784419 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28e75926-a83d-4666-b0f5-2b5180aa941a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:37.003992 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-28e75926-a83d-4666-b0f5-2b5180aa941a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:37.003992 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-28e75926-a83d-4666-b0f5-2b5180aa941a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.238375 Aug 22 17:28:37.019183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 122/251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:36 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:28:38.036118 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-09b66607-91d1-4165-a292-695fa9f6ed3d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:38.037641 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-479b22a4-6242-4f34-a216-46dc09813eb3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:38.038237 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-479b22a4-6242-4f34-a216-46dc09813eb3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:38.041704 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-09b66607-91d1-4165-a292-695fa9f6ed3d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:38.047466 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-479b22a4-6242-4f34-a216-46dc09813eb3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:38.048173 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-479b22a4-6242-4f34-a216-46dc09813eb3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:38.048491 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-09b66607-91d1-4165-a292-695fa9f6ed3d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:38.048884 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-479b22a4-6242-4f34-a216-46dc09813eb3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:38.049076 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-09b66607-91d1-4165-a292-695fa9f6ed3d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:38.049404 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-09b66607-91d1-4165-a292-695fa9f6ed3d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:38.050096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-479b22a4-6242-4f34-a216-46dc09813eb3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:38.050298 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-09b66607-91d1-4165-a292-695fa9f6ed3d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:38.051485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-479b22a4-6242-4f34-a216-46dc09813eb3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:38.051715 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-09b66607-91d1-4165-a292-695fa9f6ed3d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:38.052175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-09b66607-91d1-4165-a292-695fa9f6ed3d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:38.052337 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-479b22a4-6242-4f34-a216-46dc09813eb3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:38.068748 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-09b66607-91d1-4165-a292-695fa9f6ed3d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] HTTP exception thrown: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-09b66607-91d1-4165-a292-695fa9f6ed3d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Request method failure captured: Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: DELETE /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 HTTP/1.1 Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA7xa-IZzl4aVgbxN9aTu6MNYBc0D6ApkDZkyNYFwDrFrp0iybkcWTCZ8OBVm_KLB5aHqguKsPbxgeAgDCxZ9rpxEeG2zdWExJQkD_lh4mqmtFnDVe02m8c-p6w9mUqk70CaKQcfSfmAgqvbfKZbrQppmC1M2OEIENnKeojYVaUjhcVU Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 778299a985204da18b35d86ed8c4c77d Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-DeleteServersTestJSON-393195605 Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:28:38.071013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:28:38.073670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/778299a985204da18b35d86ed8c4c77d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/778299a985204da18b35d86ed8c4c77d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/778299a985204da18b35d86ed8c4c77d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_778299a985204da18b35d86ed8c4c77d", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:28:38.073670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-DeleteServersTestJSON-393195605 Aug 22 17:28:38.073670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 778299a985204da18b35d86ed8c4c77d Aug 22 17:28:38.073670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-DeleteServersTestJSON-393195605 Aug 22 17:28:38.073670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-DeleteServersTestJSON-393195605-project Aug 22 17:28:38.073670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:28:38.073670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:28:38.073670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: 9eedc633493b478a9009f7bce07696a8 Aug 22 17:28:38.073670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-DeleteServersTestJSON-393195605-project Aug 22 17:28:38.073670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:28:38.073670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:38.073670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': 'eb123a58-2326-45c2-8c47-e297dd1d60c2'} Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:28:38.075227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:38.077539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:38.080227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-09b66607-91d1-4165-a292-695fa9f6ed3d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Returning 404 to user: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:28:38.080227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-09b66607-91d1-4165-a292-695fa9f6ed3d tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 404 len: 111 microversion: 2.1 time: 0.040801 Aug 22 17:28:38.080227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 123/252] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:28:38 2022] DELETE /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:28:38.084818 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-27c11749-6b2d-4317-9658-1ec94d9e46c0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:38.084818 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-27c11749-6b2d-4317-9658-1ec94d9e46c0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] [instance: eb123a58-2326-45c2-8c47-e297dd1d60c2] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:38.088594 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-27c11749-6b2d-4317-9658-1ec94d9e46c0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:38.089090 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-27c11749-6b2d-4317-9658-1ec94d9e46c0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:38.089532 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-27c11749-6b2d-4317-9658-1ec94d9e46c0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:38.090313 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-27c11749-6b2d-4317-9658-1ec94d9e46c0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:38.090835 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-27c11749-6b2d-4317-9658-1ec94d9e46c0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:38.091262 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-27c11749-6b2d-4317-9658-1ec94d9e46c0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:38.107657 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-27c11749-6b2d-4317-9658-1ec94d9e46c0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] HTTP exception thrown: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-27c11749-6b2d-4317-9658-1ec94d9e46c0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Request method failure captured: Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 HTTP/1.1 Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA7xa-IZzl4aVgbxN9aTu6MNYBc0D6ApkDZkyNYFwDrFrp0iybkcWTCZ8OBVm_KLB5aHqguKsPbxgeAgDCxZ9rpxEeG2zdWExJQkD_lh4mqmtFnDVe02m8c-p6w9mUqk70CaKQcfSfmAgqvbfKZbrQppmC1M2OEIENnKeojYVaUjhcVU Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 778299a985204da18b35d86ed8c4c77d Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-DeleteServersTestJSON-393195605 Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:28:38.109199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:28:38.111587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/778299a985204da18b35d86ed8c4c77d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/778299a985204da18b35d86ed8c4c77d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/778299a985204da18b35d86ed8c4c77d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_778299a985204da18b35d86ed8c4c77d", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:28:38.111587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-DeleteServersTestJSON-393195605 Aug 22 17:28:38.111587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 778299a985204da18b35d86ed8c4c77d Aug 22 17:28:38.111587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-DeleteServersTestJSON-393195605 Aug 22 17:28:38.111587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-DeleteServersTestJSON-393195605-project Aug 22 17:28:38.111587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:28:38.111587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:28:38.111587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: 9eedc633493b478a9009f7bce07696a8 Aug 22 17:28:38.111587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-DeleteServersTestJSON-393195605-project Aug 22 17:28:38.111587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:28:38.111587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:38.111587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': 'eb123a58-2326-45c2-8c47-e297dd1d60c2'} Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:28:38.113080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. Aug 22 17:28:38.116082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:28:38.118120 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-27c11749-6b2d-4317-9658-1ec94d9e46c0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] Returning 404 to user: Instance eb123a58-2326-45c2-8c47-e297dd1d60c2 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:28:38.118120 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-27c11749-6b2d-4317-9658-1ec94d9e46c0 tempest-DeleteServersTestJSON-393195605 tempest-DeleteServersTestJSON-393195605-project] 10.222.0.20 "GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2" status: 404 len: 111 microversion: 2.1 time: 0.033979 Aug 22 17:28:38.118120 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 124/253] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:38 2022] GET /compute/v2.1/servers/eb123a58-2326-45c2-8c47-e297dd1d60c2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:28:38.336465 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-479b22a4-6242-4f34-a216-46dc09813eb3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:38.346709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-479b22a4-6242-4f34-a216-46dc09813eb3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.316663 Aug 22 17:28:38.347302 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 130/254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:38 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:39.388349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0414c372-dda7-444f-be9b-23280c78be74 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:39.394891 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0414c372-dda7-444f-be9b-23280c78be74 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:39.403457 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0414c372-dda7-444f-be9b-23280c78be74 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:39.404320 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0414c372-dda7-444f-be9b-23280c78be74 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:39.405272 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0414c372-dda7-444f-be9b-23280c78be74 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:39.406789 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0414c372-dda7-444f-be9b-23280c78be74 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:39.407747 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0414c372-dda7-444f-be9b-23280c78be74 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:39.408397 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0414c372-dda7-444f-be9b-23280c78be74 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:40.038391 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0414c372-dda7-444f-be9b-23280c78be74 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:40.053534 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0414c372-dda7-444f-be9b-23280c78be74 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.675516 Aug 22 17:28:40.055678 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 125/255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:39 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:41.091994 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e09e9fe9-c59b-45f2-b7af-5dcb0351ec16 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:41.094209 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e09e9fe9-c59b-45f2-b7af-5dcb0351ec16 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:41.110384 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e09e9fe9-c59b-45f2-b7af-5dcb0351ec16 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:41.111561 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e09e9fe9-c59b-45f2-b7af-5dcb0351ec16 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:41.112525 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e09e9fe9-c59b-45f2-b7af-5dcb0351ec16 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:41.120525 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e09e9fe9-c59b-45f2-b7af-5dcb0351ec16 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:41.120525 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e09e9fe9-c59b-45f2-b7af-5dcb0351ec16 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:41.120525 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e09e9fe9-c59b-45f2-b7af-5dcb0351ec16 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:41.345947 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e09e9fe9-c59b-45f2-b7af-5dcb0351ec16 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:41.364165 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e09e9fe9-c59b-45f2-b7af-5dcb0351ec16 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1522 microversion: 2.1 time: 0.275760 Aug 22 17:28:41.382985 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 131/256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:41 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:28:42.400012 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ff3199c8-5d0d-4754-bd41-f36fceae3ce6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:42.401955 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ff3199c8-5d0d-4754-bd41-f36fceae3ce6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:42.412929 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ff3199c8-5d0d-4754-bd41-f36fceae3ce6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:42.413682 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ff3199c8-5d0d-4754-bd41-f36fceae3ce6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:42.414413 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ff3199c8-5d0d-4754-bd41-f36fceae3ce6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:42.415671 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ff3199c8-5d0d-4754-bd41-f36fceae3ce6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:42.416460 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ff3199c8-5d0d-4754-bd41-f36fceae3ce6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:42.417193 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ff3199c8-5d0d-4754-bd41-f36fceae3ce6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:42.720099 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ff3199c8-5d0d-4754-bd41-f36fceae3ce6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:42.733313 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ff3199c8-5d0d-4754-bd41-f36fceae3ce6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1502 microversion: 2.1 time: 0.339838 Aug 22 17:28:42.734635 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 126/257] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:42 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1502 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:28:42.764879 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0bf2c461-dd08-4901-83ae-b93dbc226137 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:42.766132 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0bf2c461-dd08-4901-83ae-b93dbc226137 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:42.773849 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bf2c461-dd08-4901-83ae-b93dbc226137 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:42.774773 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bf2c461-dd08-4901-83ae-b93dbc226137 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:42.775222 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bf2c461-dd08-4901-83ae-b93dbc226137 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:42.775967 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bf2c461-dd08-4901-83ae-b93dbc226137 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:42.776475 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bf2c461-dd08-4901-83ae-b93dbc226137 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:42.776962 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bf2c461-dd08-4901-83ae-b93dbc226137 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:43.008340 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0bf2c461-dd08-4901-83ae-b93dbc226137 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:43.023078 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0bf2c461-dd08-4901-83ae-b93dbc226137 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1514 microversion: 2.1 time: 0.263036 Aug 22 17:28:43.041996 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 132/258] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:42 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1514 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:47.283765 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-16b71b0a-141d-4e06-9a3b-feee130d7164 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:28:47.287603 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-16b71b0a-141d-4e06-9a3b-feee130d7164 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:47.295643 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-16b71b0a-141d-4e06-9a3b-feee130d7164 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:47.296395 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-16b71b0a-141d-4e06-9a3b-feee130d7164 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:47.296957 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-16b71b0a-141d-4e06-9a3b-feee130d7164 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:47.297981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-16b71b0a-141d-4e06-9a3b-feee130d7164 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:47.298612 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-16b71b0a-141d-4e06-9a3b-feee130d7164 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:47.299185 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-16b71b0a-141d-4e06-9a3b-feee130d7164 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:47.343053 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-16b71b0a-141d-4e06-9a3b-feee130d7164 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lazy-loading 'flavor' on Instance uuid e4763726-f1d6-476a-b919-ad30acd9fcc4 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:28:47.695571 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a14f5fb8-2e9b-4200-b0ad-7a0b8adddbdd tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] Action: 'create', calling method: .version_select at 0x7f0e5cf73ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1098634289", "metadata": {"Type": "work"}}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:28:47.787251 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-16b71b0a-141d-4e06-9a3b-feee130d7164 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "POST /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4/action" status: 200 len: 32 microversion: 2.1 time: 0.508642 Aug 22 17:28:47.788007 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 127/259] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 22 17:28:47 2022] POST /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4/action => generated 32 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:28:47.806866 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-81a3cca2-9916-4c9d-b43a-dfa75bcb2eb6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:47.807603 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-81a3cca2-9916-4c9d-b43a-dfa75bcb2eb6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:47.820171 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-81a3cca2-9916-4c9d-b43a-dfa75bcb2eb6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:47.820771 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-81a3cca2-9916-4c9d-b43a-dfa75bcb2eb6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:47.821557 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-81a3cca2-9916-4c9d-b43a-dfa75bcb2eb6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:47.822896 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-81a3cca2-9916-4c9d-b43a-dfa75bcb2eb6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:47.824333 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-81a3cca2-9916-4c9d-b43a-dfa75bcb2eb6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:47.825318 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-81a3cca2-9916-4c9d-b43a-dfa75bcb2eb6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:48.118981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-81a3cca2-9916-4c9d-b43a-dfa75bcb2eb6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:48.144541 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-81a3cca2-9916-4c9d-b43a-dfa75bcb2eb6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.337278 Aug 22 17:28:48.144541 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 128/260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:47 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:48.778969 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a14f5fb8-2e9b-4200-b0ad-7a0b8adddbdd tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.277937 Aug 22 17:28:48.778969 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 133/261] 10.222.0.20 () {60 vars in 1156 bytes} [Mon Aug 22 17:28:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1281 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 22 17:28:48.796229 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b2964dbc-713d-4920-8360-e3ecfd522488 tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] Calling method '.version_select at 0x7f0e5c87c550>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:48.921149 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b2964dbc-713d-4920-8360-e3ecfd522488 tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/6e922438-9169-49a0-a346-aa0b03813011" status: 200 len: 353 microversion: 2.1 time: 0.132168 Aug 22 17:28:48.921958 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 129/262] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 22 17:28:48 2022] GET /compute/v2.1/os-volumes/6e922438-9169-49a0-a346-aa0b03813011 => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:28:49.165931 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8c0e23f7-73a9-4d0f-9f48-286107f0a664 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:49.166768 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8c0e23f7-73a9-4d0f-9f48-286107f0a664 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:49.177460 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c0e23f7-73a9-4d0f-9f48-286107f0a664 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:49.178065 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c0e23f7-73a9-4d0f-9f48-286107f0a664 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:49.178612 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c0e23f7-73a9-4d0f-9f48-286107f0a664 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:49.179513 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c0e23f7-73a9-4d0f-9f48-286107f0a664 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:49.180170 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c0e23f7-73a9-4d0f-9f48-286107f0a664 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:49.180639 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c0e23f7-73a9-4d0f-9f48-286107f0a664 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:49.493025 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8c0e23f7-73a9-4d0f-9f48-286107f0a664 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:49.508843 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8c0e23f7-73a9-4d0f-9f48-286107f0a664 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.346577 Aug 22 17:28:49.509832 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 134/263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:49 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:28:49.938719 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-20417862-ddc0-4b55-b542-1a431c5b9e57 tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] Calling method '.version_select at 0x7f0e5c87c820>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:50.005150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-20417862-ddc0-4b55-b542-1a431c5b9e57 tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/6e922438-9169-49a0-a346-aa0b03813011" status: 200 len: 354 microversion: 2.1 time: 0.072432 Aug 22 17:28:50.006220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 130/264] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 22 17:28:49 2022] GET /compute/v2.1/os-volumes/6e922438-9169-49a0-a346-aa0b03813011 => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:28:50.023289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-55ce3030-3899-42b2-80c0-8016934866e5 tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] Calling method '.version_select at 0x7f0e5cf73ca0>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:50.082718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-55ce3030-3899-42b2-80c0-8016934866e5 tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/6e922438-9169-49a0-a346-aa0b03813011" status: 200 len: 354 microversion: 2.1 time: 0.064488 Aug 22 17:28:50.083500 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 135/265] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 22 17:28:50 2022] GET /compute/v2.1/os-volumes/6e922438-9169-49a0-a346-aa0b03813011 => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:28:50.103618 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-215e15a8-5462-4b31-8bda-641dffbda165 tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] Calling method '.version_select at 0x7f0e5c810af0>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:50.461266 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-215e15a8-5462-4b31-8bda-641dffbda165 tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/6e922438-9169-49a0-a346-aa0b03813011" status: 202 len: 0 microversion: 2.1 time: 0.361842 Aug 22 17:28:50.461944 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 131/266] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 22 17:28:50 2022] DELETE /compute/v2.1/os-volumes/6e922438-9169-49a0-a346-aa0b03813011 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:28:50.477812 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c21cc0ad-1c6b-4c33-b44d-5e2013eba233 tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] Calling method '.version_select at 0x7f0e5d068ca0>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:50.543116 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8c0ca9b1-1e7f-4777-989c-6e0b37875b15 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:50.544202 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8c0ca9b1-1e7f-4777-989c-6e0b37875b15 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:50.548934 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c21cc0ad-1c6b-4c33-b44d-5e2013eba233 tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/6e922438-9169-49a0-a346-aa0b03813011" status: 200 len: 353 microversion: 2.1 time: 0.079569 Aug 22 17:28:50.553648 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 136/267] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 22 17:28:50 2022] GET /compute/v2.1/os-volumes/6e922438-9169-49a0-a346-aa0b03813011 => generated 353 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:28:50.553841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8c0ca9b1-1e7f-4777-989c-6e0b37875b15 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:50.553841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8c0ca9b1-1e7f-4777-989c-6e0b37875b15 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:50.554141 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8c0ca9b1-1e7f-4777-989c-6e0b37875b15 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:50.554779 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8c0ca9b1-1e7f-4777-989c-6e0b37875b15 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:50.555246 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8c0ca9b1-1e7f-4777-989c-6e0b37875b15 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:50.555684 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8c0ca9b1-1e7f-4777-989c-6e0b37875b15 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:50.726235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8c0ca9b1-1e7f-4777-989c-6e0b37875b15 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:50.738959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8c0ca9b1-1e7f-4777-989c-6e0b37875b15 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.202390 Aug 22 17:28:50.739701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 132/268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:50 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:28:51.570252 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-620c5a6f-c075-4096-9bf2-bde9df1f068a tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] Calling method '.version_select at 0x7f0e5d0910d0>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:51.604508 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-620c5a6f-c075-4096-9bf2-bde9df1f068a tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] HTTP exception thrown: Volume 6e922438-9169-49a0-a346-aa0b03813011 could not be found. Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-620c5a6f-c075-4096-9bf2-bde9df1f068a tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] Request method failure captured: Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/os-volumes/6e922438-9169-49a0-a346-aa0b03813011 HTTP/1.1 Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7zP4ymvhOzg_BKEx40gsI-dHh86bURz0yzKdFjxTJrzKC-rdC0QE-10z3ofxnVLqYDDVKYsHUWmhmLv9yJmCx1GJrX38NXJRoMmo_umzlMyYG50sQpBS2qD1s7c7K6lNuzhEjl8TCeG_I8fmmcxYwR9QanmxuYNGGi7QoJFqFGhw1k Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 664207f6e402484ba1a3eb5691cbe51c Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-VolumesGetTestJSON-1563925305 Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:28:51.606661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:28:51.609313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/664207f6e402484ba1a3eb5691cbe51c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/664207f6e402484ba1a3eb5691cbe51c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/664207f6e402484ba1a3eb5691cbe51c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_664207f6e402484ba1a3eb5691cbe51c", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:28:51.609313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-VolumesGetTestJSON-1563925305 Aug 22 17:28:51.609313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 664207f6e402484ba1a3eb5691cbe51c Aug 22 17:28:51.609313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-VolumesGetTestJSON-1563925305 Aug 22 17:28:51.609313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-VolumesGetTestJSON-1563925305-project Aug 22 17:28:51.609313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:28:51.609313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:28:51.609313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 1f2f13e8538f41f8b040c90fa74e2b58 Aug 22 17:28:51.609313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-VolumesGetTestJSON-1563925305-project Aug 22 17:28:51.609313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: Aug 22 17:28:51.609313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Volume 6e922438-9169-49a0-a346-aa0b03813011 could not be found. Aug 22 17:28:51.609313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '6e922438-9169-49a0-a346-aa0b03813011'} Aug 22 17:28:51.609313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e922438-9169-49a0-a346-aa0b03813011 could not be found. (HTTP 404) (Request-ID: req-10dfe234-7d6d-4bdb-a285-67300ea440b6) Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:28:51.610452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:28:51.612096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e922438-9169-49a0-a346-aa0b03813011 could not be found. Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 17:28:51.614863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:28:51.617100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e922438-9169-49a0-a346-aa0b03813011 could not be found. Aug 22 17:28:51.617100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:28:51.617100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:28:51.617100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:28:51.617100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:28:51.617100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:28:51.617100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:28:51.617100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:28:51.617100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:28:51.617100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e922438-9169-49a0-a346-aa0b03813011 could not be found. Aug 22 17:28:51.617100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:28:51.617100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-620c5a6f-c075-4096-9bf2-bde9df1f068a tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] Returning 404 to user: Volume 6e922438-9169-49a0-a346-aa0b03813011 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:28:51.617100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-620c5a6f-c075-4096-9bf2-bde9df1f068a tempest-VolumesGetTestJSON-1563925305 tempest-VolumesGetTestJSON-1563925305-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/6e922438-9169-49a0-a346-aa0b03813011" status: 404 len: 109 microversion: 2.1 time: 0.042881 Aug 22 17:28:51.617100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 137/269] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 22 17:28:51 2022] GET /compute/v2.1/os-volumes/6e922438-9169-49a0-a346-aa0b03813011 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:28:51.765981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-314382a0-3585-4340-92e0-35ea186e2fef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:51.767396 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-314382a0-3585-4340-92e0-35ea186e2fef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:51.781273 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-314382a0-3585-4340-92e0-35ea186e2fef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:51.782104 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-314382a0-3585-4340-92e0-35ea186e2fef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:51.782875 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-314382a0-3585-4340-92e0-35ea186e2fef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:51.784128 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-314382a0-3585-4340-92e0-35ea186e2fef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:51.786429 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-314382a0-3585-4340-92e0-35ea186e2fef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:51.787276 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-314382a0-3585-4340-92e0-35ea186e2fef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:51.824188 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:52.007812 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-314382a0-3585-4340-92e0-35ea186e2fef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:52.024862 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-314382a0-3585-4340-92e0-35ea186e2fef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.262449 Aug 22 17:28:52.026961 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 133/270] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:51 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:53.069536 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-37e0f120-b661-462d-90e0-dcf9568afe97 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:53.070852 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-37e0f120-b661-462d-90e0-dcf9568afe97 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:53.073106 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=42 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:28:53.090974 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-37e0f120-b661-462d-90e0-dcf9568afe97 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:53.091860 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-37e0f120-b661-462d-90e0-dcf9568afe97 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:53.092850 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-37e0f120-b661-462d-90e0-dcf9568afe97 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:53.094256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-37e0f120-b661-462d-90e0-dcf9568afe97 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:53.095812 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-37e0f120-b661-462d-90e0-dcf9568afe97 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:53.096569 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-37e0f120-b661-462d-90e0-dcf9568afe97 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:53.275432 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-37e0f120-b661-462d-90e0-dcf9568afe97 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:53.288041 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-37e0f120-b661-462d-90e0-dcf9568afe97 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.226961 Aug 22 17:28:53.289015 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 138/271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:53 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:54.317582 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-de4e36a6-bc54-4622-ba3a-c923590bfd75 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:54.318907 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-de4e36a6-bc54-4622-ba3a-c923590bfd75 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:54.330077 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-de4e36a6-bc54-4622-ba3a-c923590bfd75 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:54.330833 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-de4e36a6-bc54-4622-ba3a-c923590bfd75 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:54.331672 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-de4e36a6-bc54-4622-ba3a-c923590bfd75 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:54.332869 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-de4e36a6-bc54-4622-ba3a-c923590bfd75 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:54.333641 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-de4e36a6-bc54-4622-ba3a-c923590bfd75 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:54.334354 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-de4e36a6-bc54-4622-ba3a-c923590bfd75 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:54.588672 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-de4e36a6-bc54-4622-ba3a-c923590bfd75 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:54.609061 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-de4e36a6-bc54-4622-ba3a-c923590bfd75 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.298493 Aug 22 17:28:54.611409 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 134/272] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:54 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:55.671488 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0e7c1a45-b2bc-4e38-9531-513cd22ac0e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:55.676155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0e7c1a45-b2bc-4e38-9531-513cd22ac0e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:55.697941 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e7c1a45-b2bc-4e38-9531-513cd22ac0e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:55.698897 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e7c1a45-b2bc-4e38-9531-513cd22ac0e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:55.699694 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e7c1a45-b2bc-4e38-9531-513cd22ac0e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:55.700910 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e7c1a45-b2bc-4e38-9531-513cd22ac0e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:55.702124 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e7c1a45-b2bc-4e38-9531-513cd22ac0e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:55.703241 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e7c1a45-b2bc-4e38-9531-513cd22ac0e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:55.966929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0e7c1a45-b2bc-4e38-9531-513cd22ac0e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:55.980096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0e7c1a45-b2bc-4e38-9531-513cd22ac0e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.319008 Aug 22 17:28:55.981064 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 139/273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:55 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:57.005647 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c3a16ec7-6579-4894-bdd8-734e3b97bea9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:57.006801 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c3a16ec7-6579-4894-bdd8-734e3b97bea9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:57.018273 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c3a16ec7-6579-4894-bdd8-734e3b97bea9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:57.020209 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c3a16ec7-6579-4894-bdd8-734e3b97bea9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:57.021199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c3a16ec7-6579-4894-bdd8-734e3b97bea9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:57.022701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c3a16ec7-6579-4894-bdd8-734e3b97bea9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:57.023427 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c3a16ec7-6579-4894-bdd8-734e3b97bea9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:57.024613 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c3a16ec7-6579-4894-bdd8-734e3b97bea9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:57.205524 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c3a16ec7-6579-4894-bdd8-734e3b97bea9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:57.215457 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c3a16ec7-6579-4894-bdd8-734e3b97bea9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.216039 Aug 22 17:28:57.216010 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 135/274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:56 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:58.245267 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5cbe8d4d-dd40-4400-80cd-2c37a15a7907 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:58.246302 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5cbe8d4d-dd40-4400-80cd-2c37a15a7907 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:58.256665 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5cbe8d4d-dd40-4400-80cd-2c37a15a7907 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:58.257462 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5cbe8d4d-dd40-4400-80cd-2c37a15a7907 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:58.258005 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5cbe8d4d-dd40-4400-80cd-2c37a15a7907 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:58.259325 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5cbe8d4d-dd40-4400-80cd-2c37a15a7907 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:58.259998 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5cbe8d4d-dd40-4400-80cd-2c37a15a7907 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:58.260683 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5cbe8d4d-dd40-4400-80cd-2c37a15a7907 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:58.448628 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5cbe8d4d-dd40-4400-80cd-2c37a15a7907 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:58.463789 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5cbe8d4d-dd40-4400-80cd-2c37a15a7907 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.225382 Aug 22 17:28:58.464866 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 140/275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:58 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:28:59.486637 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1fdffc1e-2be5-42c0-828c-d4f7d16d59cc tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:28:59.487288 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1fdffc1e-2be5-42c0-828c-d4f7d16d59cc tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:28:59.494989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1fdffc1e-2be5-42c0-828c-d4f7d16d59cc tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:59.495486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1fdffc1e-2be5-42c0-828c-d4f7d16d59cc tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:59.495983 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1fdffc1e-2be5-42c0-828c-d4f7d16d59cc tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:59.499168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1fdffc1e-2be5-42c0-828c-d4f7d16d59cc tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:28:59.499168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1fdffc1e-2be5-42c0-828c-d4f7d16d59cc tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:28:59.499168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1fdffc1e-2be5-42c0-828c-d4f7d16d59cc tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:28:59.685565 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1fdffc1e-2be5-42c0-828c-d4f7d16d59cc tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:28:59.694455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1fdffc1e-2be5-42c0-828c-d4f7d16d59cc tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.211802 Aug 22 17:28:59.695072 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 136/276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:28:59 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:00.730071 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0fe006f7-9731-4b51-9889-b1fb2cd2adba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:00.730933 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0fe006f7-9731-4b51-9889-b1fb2cd2adba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:00.743772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0fe006f7-9731-4b51-9889-b1fb2cd2adba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:00.744099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0fe006f7-9731-4b51-9889-b1fb2cd2adba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:00.744574 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0fe006f7-9731-4b51-9889-b1fb2cd2adba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:00.745341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0fe006f7-9731-4b51-9889-b1fb2cd2adba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:00.745896 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0fe006f7-9731-4b51-9889-b1fb2cd2adba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:00.746394 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0fe006f7-9731-4b51-9889-b1fb2cd2adba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:00.959609 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0fe006f7-9731-4b51-9889-b1fb2cd2adba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:00.962045 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=79 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:00.968928 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0fe006f7-9731-4b51-9889-b1fb2cd2adba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.243816 Aug 22 17:29:00.969532 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 141/277] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:00 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:01.993100 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-9efb3275-785d-43d7-bccf-431735794e83 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:01.993781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9efb3275-785d-43d7-bccf-431735794e83 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:02.001420 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9efb3275-785d-43d7-bccf-431735794e83 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:02.001973 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9efb3275-785d-43d7-bccf-431735794e83 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:02.003222 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9efb3275-785d-43d7-bccf-431735794e83 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:02.004088 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9efb3275-785d-43d7-bccf-431735794e83 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:02.004586 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9efb3275-785d-43d7-bccf-431735794e83 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:02.005107 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9efb3275-785d-43d7-bccf-431735794e83 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:02.166440 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-9efb3275-785d-43d7-bccf-431735794e83 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:02.175633 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-9efb3275-785d-43d7-bccf-431735794e83 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.186598 Aug 22 17:29:02.176421 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 137/278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:01 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:03.197339 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-71b3329c-b0ab-499b-8cc8-2a6a5bdf0bf6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:03.197958 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-71b3329c-b0ab-499b-8cc8-2a6a5bdf0bf6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:03.205091 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-71b3329c-b0ab-499b-8cc8-2a6a5bdf0bf6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:03.205641 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-71b3329c-b0ab-499b-8cc8-2a6a5bdf0bf6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:03.206089 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-71b3329c-b0ab-499b-8cc8-2a6a5bdf0bf6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:03.207356 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-71b3329c-b0ab-499b-8cc8-2a6a5bdf0bf6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:03.207819 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-71b3329c-b0ab-499b-8cc8-2a6a5bdf0bf6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:03.208249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-71b3329c-b0ab-499b-8cc8-2a6a5bdf0bf6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:03.384947 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-71b3329c-b0ab-499b-8cc8-2a6a5bdf0bf6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:03.395413 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-71b3329c-b0ab-499b-8cc8-2a6a5bdf0bf6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.202416 Aug 22 17:29:03.396030 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 142/279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:03 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:29:04.416504 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f5f361f6-41f2-4fdd-b90c-659cd42775ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:04.417139 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f5f361f6-41f2-4fdd-b90c-659cd42775ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:04.419387 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=32 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:04.424607 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f5f361f6-41f2-4fdd-b90c-659cd42775ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:04.425117 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f5f361f6-41f2-4fdd-b90c-659cd42775ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:04.425556 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f5f361f6-41f2-4fdd-b90c-659cd42775ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:04.426278 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f5f361f6-41f2-4fdd-b90c-659cd42775ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:04.426762 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f5f361f6-41f2-4fdd-b90c-659cd42775ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:04.427188 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f5f361f6-41f2-4fdd-b90c-659cd42775ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:04.590942 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f5f361f6-41f2-4fdd-b90c-659cd42775ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:04.604370 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f5f361f6-41f2-4fdd-b90c-659cd42775ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.191563 Aug 22 17:29:04.605323 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 138/280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:04 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:05.631073 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5a87a227-61a6-4a11-aa10-48ad28ccdfc0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:05.632080 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5a87a227-61a6-4a11-aa10-48ad28ccdfc0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:05.639638 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a87a227-61a6-4a11-aa10-48ad28ccdfc0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:05.640166 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a87a227-61a6-4a11-aa10-48ad28ccdfc0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:05.640666 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a87a227-61a6-4a11-aa10-48ad28ccdfc0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:05.641311 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a87a227-61a6-4a11-aa10-48ad28ccdfc0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:05.641773 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a87a227-61a6-4a11-aa10-48ad28ccdfc0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:05.642201 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a87a227-61a6-4a11-aa10-48ad28ccdfc0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:05.825083 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5a87a227-61a6-4a11-aa10-48ad28ccdfc0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:05.836273 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5a87a227-61a6-4a11-aa10-48ad28ccdfc0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.210119 Aug 22 17:29:05.837167 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 143/281] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:05 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:29:06.866781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d278c63a-4f5c-4aa7-8a18-4d65c05ff086 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:06.867855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d278c63a-4f5c-4aa7-8a18-4d65c05ff086 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:06.879871 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d278c63a-4f5c-4aa7-8a18-4d65c05ff086 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:06.880748 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d278c63a-4f5c-4aa7-8a18-4d65c05ff086 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:06.881543 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d278c63a-4f5c-4aa7-8a18-4d65c05ff086 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:06.882902 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d278c63a-4f5c-4aa7-8a18-4d65c05ff086 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:06.883738 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d278c63a-4f5c-4aa7-8a18-4d65c05ff086 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:06.884480 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d278c63a-4f5c-4aa7-8a18-4d65c05ff086 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:07.086298 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d278c63a-4f5c-4aa7-8a18-4d65c05ff086 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:07.099325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d278c63a-4f5c-4aa7-8a18-4d65c05ff086 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.241847 Aug 22 17:29:07.100404 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 139/282] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:06 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:08.121985 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a91d23af-2c2c-4d7d-beca-49d4f1f04fdd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:08.122664 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a91d23af-2c2c-4d7d-beca-49d4f1f04fdd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:08.130166 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a91d23af-2c2c-4d7d-beca-49d4f1f04fdd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:08.130711 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a91d23af-2c2c-4d7d-beca-49d4f1f04fdd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:08.131162 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a91d23af-2c2c-4d7d-beca-49d4f1f04fdd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:08.131882 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a91d23af-2c2c-4d7d-beca-49d4f1f04fdd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:08.132339 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a91d23af-2c2c-4d7d-beca-49d4f1f04fdd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:08.132770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a91d23af-2c2c-4d7d-beca-49d4f1f04fdd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:08.288775 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a91d23af-2c2c-4d7d-beca-49d4f1f04fdd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:08.298238 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a91d23af-2c2c-4d7d-beca-49d4f1f04fdd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.180513 Aug 22 17:29:08.299018 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 144/283] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:08 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:29:09.321911 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6bdb4298-50af-4eff-ab1a-51e4917e79e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:09.322621 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6bdb4298-50af-4eff-ab1a-51e4917e79e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:09.328946 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6bdb4298-50af-4eff-ab1a-51e4917e79e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:09.330358 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6bdb4298-50af-4eff-ab1a-51e4917e79e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:09.331018 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6bdb4298-50af-4eff-ab1a-51e4917e79e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:09.332718 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6bdb4298-50af-4eff-ab1a-51e4917e79e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:09.333257 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6bdb4298-50af-4eff-ab1a-51e4917e79e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:09.333717 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6bdb4298-50af-4eff-ab1a-51e4917e79e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:09.515098 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6bdb4298-50af-4eff-ab1a-51e4917e79e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:09.523944 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6bdb4298-50af-4eff-ab1a-51e4917e79e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.206106 Aug 22 17:29:09.524548 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 140/284] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:09 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:10.569746 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6b326e5d-efb0-48da-b3f3-32c5878260e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:10.571736 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6b326e5d-efb0-48da-b3f3-32c5878260e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:10.587783 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6b326e5d-efb0-48da-b3f3-32c5878260e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:10.588450 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6b326e5d-efb0-48da-b3f3-32c5878260e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:10.589116 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6b326e5d-efb0-48da-b3f3-32c5878260e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:10.590038 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6b326e5d-efb0-48da-b3f3-32c5878260e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:10.590749 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6b326e5d-efb0-48da-b3f3-32c5878260e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:10.591345 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6b326e5d-efb0-48da-b3f3-32c5878260e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:10.753864 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6b326e5d-efb0-48da-b3f3-32c5878260e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:10.763262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6b326e5d-efb0-48da-b3f3-32c5878260e2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.206222 Aug 22 17:29:10.764123 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 145/285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:10 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:11.789474 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-15768906-cbd2-4fef-a385-a083c0ebc8f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:11.791749 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-15768906-cbd2-4fef-a385-a083c0ebc8f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:11.800939 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-15768906-cbd2-4fef-a385-a083c0ebc8f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:11.802218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-15768906-cbd2-4fef-a385-a083c0ebc8f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:11.802959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-15768906-cbd2-4fef-a385-a083c0ebc8f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:11.803911 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-15768906-cbd2-4fef-a385-a083c0ebc8f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:11.804498 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-15768906-cbd2-4fef-a385-a083c0ebc8f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:11.805141 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-15768906-cbd2-4fef-a385-a083c0ebc8f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:11.980380 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-15768906-cbd2-4fef-a385-a083c0ebc8f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:11.990210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-15768906-cbd2-4fef-a385-a083c0ebc8f1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.208073 Aug 22 17:29:11.990836 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 141/286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:11 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:13.023132 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5decfcf9-589b-4626-8eba-2947f1bba877 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:13.025293 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5decfcf9-589b-4626-8eba-2947f1bba877 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:13.039514 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5decfcf9-589b-4626-8eba-2947f1bba877 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:13.044348 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5decfcf9-589b-4626-8eba-2947f1bba877 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:13.044348 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5decfcf9-589b-4626-8eba-2947f1bba877 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:13.044348 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5decfcf9-589b-4626-8eba-2947f1bba877 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:13.044348 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5decfcf9-589b-4626-8eba-2947f1bba877 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:13.045744 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5decfcf9-589b-4626-8eba-2947f1bba877 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:13.236277 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5decfcf9-589b-4626-8eba-2947f1bba877 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:13.247318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5decfcf9-589b-4626-8eba-2947f1bba877 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.234880 Aug 22 17:29:13.247928 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 146/287] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:13 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:14.280292 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d34f7b14-ddf8-4db1-88c6-abde0b9bc328 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:14.281199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d34f7b14-ddf8-4db1-88c6-abde0b9bc328 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:14.290590 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d34f7b14-ddf8-4db1-88c6-abde0b9bc328 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:14.291324 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d34f7b14-ddf8-4db1-88c6-abde0b9bc328 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:14.291866 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d34f7b14-ddf8-4db1-88c6-abde0b9bc328 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:14.292672 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d34f7b14-ddf8-4db1-88c6-abde0b9bc328 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:14.293455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d34f7b14-ddf8-4db1-88c6-abde0b9bc328 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:14.294183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d34f7b14-ddf8-4db1-88c6-abde0b9bc328 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:14.511448 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d34f7b14-ddf8-4db1-88c6-abde0b9bc328 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:14.526705 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d34f7b14-ddf8-4db1-88c6-abde0b9bc328 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.249765 Aug 22 17:29:14.527774 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 142/288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:14 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:15.559792 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-79c60fe5-dfee-4e52-a67c-40f28fabb35b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:15.560460 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-79c60fe5-dfee-4e52-a67c-40f28fabb35b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:15.568676 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-79c60fe5-dfee-4e52-a67c-40f28fabb35b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:15.569543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-79c60fe5-dfee-4e52-a67c-40f28fabb35b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:15.570336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-79c60fe5-dfee-4e52-a67c-40f28fabb35b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:15.571735 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-79c60fe5-dfee-4e52-a67c-40f28fabb35b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:15.572587 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-79c60fe5-dfee-4e52-a67c-40f28fabb35b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:15.573378 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-79c60fe5-dfee-4e52-a67c-40f28fabb35b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:15.753743 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-79c60fe5-dfee-4e52-a67c-40f28fabb35b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:15.764101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-79c60fe5-dfee-4e52-a67c-40f28fabb35b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.207834 Aug 22 17:29:15.765173 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 147/289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:15 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:16.787365 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b1b78811-e512-42f5-a1f9-96e751cfb024 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:16.788406 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b1b78811-e512-42f5-a1f9-96e751cfb024 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:16.795639 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1b78811-e512-42f5-a1f9-96e751cfb024 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:16.796131 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1b78811-e512-42f5-a1f9-96e751cfb024 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:16.797500 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1b78811-e512-42f5-a1f9-96e751cfb024 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:16.797500 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1b78811-e512-42f5-a1f9-96e751cfb024 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:16.797777 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1b78811-e512-42f5-a1f9-96e751cfb024 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:16.798116 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1b78811-e512-42f5-a1f9-96e751cfb024 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:16.997854 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b1b78811-e512-42f5-a1f9-96e751cfb024 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:17.013499 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b1b78811-e512-42f5-a1f9-96e751cfb024 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1500 microversion: 2.1 time: 0.230299 Aug 22 17:29:17.014810 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 143/290] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:16 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1500 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:17.061191 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5753ebd8-5492-4f80-af6a-ff33fde77f13 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0846f00-d911-4e14-955f-c724263670e7"}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:29:17.063877 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5753ebd8-5492-4f80-af6a-ff33fde77f13 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:17.071607 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5753ebd8-5492-4f80-af6a-ff33fde77f13 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:17.072194 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5753ebd8-5492-4f80-af6a-ff33fde77f13 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:17.072668 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5753ebd8-5492-4f80-af6a-ff33fde77f13 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:17.073690 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5753ebd8-5492-4f80-af6a-ff33fde77f13 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:17.074310 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5753ebd8-5492-4f80-af6a-ff33fde77f13 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:17.075042 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5753ebd8-5492-4f80-af6a-ff33fde77f13 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:17.107638 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-5753ebd8-5492-4f80-af6a-ff33fde77f13 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] HTTP exception thrown: Cannot 'attach_volume' instance e4763726-f1d6-476a-b919-ad30acd9fcc4 while it is in vm_state rescued Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5753ebd8-5492-4f80-af6a-ff33fde77f13 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Request method failure captured: Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: POST /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4/os-volume_attachments HTTP/1.1 Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 74 Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xXN8baaPK_MH4cED3CcghEWE-YceYDcUGSHqs14knAq32J1JqzpO0cyhzH_BH89JF7lD9EeFtriNkgpyiRD5SIvJiBn9c3eg-HMVaHqC4GnaFGBixvu6HvsWUG2lq4eV2Tb6cR5BguIlgiXJnd81Kk1-dMJMjSy3tqg7llKtV_pTM Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: de12c2563d50474cac799d50041a2fa0 Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:29:17.109905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:29:17.112159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de12c2563d50474cac799d50041a2fa0", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:29:17.112159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:29:17.112159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: de12c2563d50474cac799d50041a2fa0 Aug 22 17:29:17.112159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:29:17.112159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-ServerRescueNegativeTestJSON-1723447613-project Aug 22 17:29:17.112159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:29:17.112159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:29:17.112159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: f46cbc7de18c4f9fb6f54e96be53fea0 Aug 22 17:29:17.112159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1723447613-project Aug 22 17:29:17.112159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Aug 22 17:29:17.112159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {"volumeAttachment": {"volumeId": "d0846f00-d911-4e14-955f-c724263670e7"}} Aug 22 17:29:17.112159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Cannot 'attach_volume' instance e4763726-f1d6-476a-b919-ad30acd9fcc4 while it is in vm_state rescued Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'server_id': 'e4763726-f1d6-476a-b919-ad30acd9fcc4', 'body': {'volumeAttachment': {'volumeId': 'd0846f00-d911-4e14-955f-c724263670e7'}}} Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e4763726-f1d6-476a-b919-ad30acd9fcc4 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:29:17.113709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e4763726-f1d6-476a-b919-ad30acd9fcc4 while it is in vm_state rescued Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:29:17.115868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:29:17.118088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:29:17.118088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:29:17.118088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e4763726-f1d6-476a-b919-ad30acd9fcc4 while it is in vm_state rescued Aug 22 17:29:17.118088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:29:17.118088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5753ebd8-5492-4f80-af6a-ff33fde77f13 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Returning 409 to user: Cannot 'attach_volume' instance e4763726-f1d6-476a-b919-ad30acd9fcc4 while it is in vm_state rescued {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:29:17.118088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5753ebd8-5492-4f80-af6a-ff33fde77f13 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "POST /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056771 Aug 22 17:29:17.118088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 148/291] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 22 17:29:17 2022] POST /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4/os-volume_attachments => generated 152 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 22 17:29:17.125407 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c0c55840-c3f4-4713-9d42-9e4419404c19 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:29:17.125994 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c0c55840-c3f4-4713-9d42-9e4419404c19 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:17.133600 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c0c55840-c3f4-4713-9d42-9e4419404c19 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:17.134247 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c0c55840-c3f4-4713-9d42-9e4419404c19 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:17.134724 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c0c55840-c3f4-4713-9d42-9e4419404c19 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:17.135495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c0c55840-c3f4-4713-9d42-9e4419404c19 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:17.136023 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c0c55840-c3f4-4713-9d42-9e4419404c19 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:17.136561 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c0c55840-c3f4-4713-9d42-9e4419404c19 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:17.401345 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c0c55840-c3f4-4713-9d42-9e4419404c19 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "POST /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4/action" status: 202 len: 0 microversion: 2.1 time: 0.280254 Aug 22 17:29:17.402069 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 144/292] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 22 17:29:17 2022] POST /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4/action => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:29:17.413790 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f34fba57-fed8-4363-995c-06dbd0423f4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:17.414296 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f34fba57-fed8-4363-995c-06dbd0423f4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:17.420890 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f34fba57-fed8-4363-995c-06dbd0423f4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:17.421378 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f34fba57-fed8-4363-995c-06dbd0423f4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:17.421811 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f34fba57-fed8-4363-995c-06dbd0423f4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:17.423115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f34fba57-fed8-4363-995c-06dbd0423f4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:17.423115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f34fba57-fed8-4363-995c-06dbd0423f4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:17.423473 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f34fba57-fed8-4363-995c-06dbd0423f4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:17.621471 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f34fba57-fed8-4363-995c-06dbd0423f4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:17.641458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f34fba57-fed8-4363-995c-06dbd0423f4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1508 microversion: 2.1 time: 0.231637 Aug 22 17:29:17.657147 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 149/293] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:17 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:18.680451 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f4c42ad7-3975-4abb-b00a-49b3c9586779 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:18.681748 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f4c42ad7-3975-4abb-b00a-49b3c9586779 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:18.693541 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f4c42ad7-3975-4abb-b00a-49b3c9586779 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:18.694519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f4c42ad7-3975-4abb-b00a-49b3c9586779 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:18.695275 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f4c42ad7-3975-4abb-b00a-49b3c9586779 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:18.696559 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f4c42ad7-3975-4abb-b00a-49b3c9586779 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:18.697372 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f4c42ad7-3975-4abb-b00a-49b3c9586779 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:18.698099 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f4c42ad7-3975-4abb-b00a-49b3c9586779 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:19.088524 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f4c42ad7-3975-4abb-b00a-49b3c9586779 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:19.103015 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f4c42ad7-3975-4abb-b00a-49b3c9586779 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1508 microversion: 2.1 time: 0.430193 Aug 22 17:29:19.104052 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 145/294] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:18 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1508 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:20.139831 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-64100236-93f6-43c0-98a4-56926d18f0d0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:20.140609 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-64100236-93f6-43c0-98a4-56926d18f0d0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:20.147769 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-64100236-93f6-43c0-98a4-56926d18f0d0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:20.148267 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-64100236-93f6-43c0-98a4-56926d18f0d0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:20.148702 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-64100236-93f6-43c0-98a4-56926d18f0d0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:20.149406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-64100236-93f6-43c0-98a4-56926d18f0d0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:20.149861 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-64100236-93f6-43c0-98a4-56926d18f0d0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:20.150279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-64100236-93f6-43c0-98a4-56926d18f0d0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:20.316343 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-64100236-93f6-43c0-98a4-56926d18f0d0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:20.325041 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-64100236-93f6-43c0-98a4-56926d18f0d0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1508 microversion: 2.1 time: 0.189395 Aug 22 17:29:20.325683 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 150/295] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:20 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:21.346163 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c7d97553-698f-40ef-a6d0-17806a4ae7e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:21.346967 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c7d97553-698f-40ef-a6d0-17806a4ae7e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:21.353486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7d97553-698f-40ef-a6d0-17806a4ae7e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:21.354068 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7d97553-698f-40ef-a6d0-17806a4ae7e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:21.354591 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7d97553-698f-40ef-a6d0-17806a4ae7e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:21.355398 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7d97553-698f-40ef-a6d0-17806a4ae7e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:21.355894 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7d97553-698f-40ef-a6d0-17806a4ae7e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:21.356380 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7d97553-698f-40ef-a6d0-17806a4ae7e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:21.774990 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c7d97553-698f-40ef-a6d0-17806a4ae7e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:21.784257 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c7d97553-698f-40ef-a6d0-17806a4ae7e9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1508 microversion: 2.1 time: 0.441523 Aug 22 17:29:21.785014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 146/296] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:21 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1508 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:22.806638 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-93787db1-c1be-4b08-b9db-8731877170e5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:22.807294 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-93787db1-c1be-4b08-b9db-8731877170e5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:22.814464 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-93787db1-c1be-4b08-b9db-8731877170e5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:22.818023 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-93787db1-c1be-4b08-b9db-8731877170e5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:22.818023 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-93787db1-c1be-4b08-b9db-8731877170e5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:22.818023 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-93787db1-c1be-4b08-b9db-8731877170e5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:22.818023 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-93787db1-c1be-4b08-b9db-8731877170e5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:22.818562 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-93787db1-c1be-4b08-b9db-8731877170e5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:22.982242 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-93787db1-c1be-4b08-b9db-8731877170e5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:22.991775 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-93787db1-c1be-4b08-b9db-8731877170e5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1508 microversion: 2.1 time: 0.189327 Aug 22 17:29:22.992524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 151/297] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:22 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1508 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:24.014597 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6062cc32-b8b6-4ef1-83ee-6fca3cc01eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:24.015302 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6062cc32-b8b6-4ef1-83ee-6fca3cc01eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:24.021868 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6062cc32-b8b6-4ef1-83ee-6fca3cc01eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:24.022357 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6062cc32-b8b6-4ef1-83ee-6fca3cc01eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:24.022827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6062cc32-b8b6-4ef1-83ee-6fca3cc01eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:24.023540 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6062cc32-b8b6-4ef1-83ee-6fca3cc01eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:24.023991 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6062cc32-b8b6-4ef1-83ee-6fca3cc01eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:24.024412 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6062cc32-b8b6-4ef1-83ee-6fca3cc01eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:24.208267 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6062cc32-b8b6-4ef1-83ee-6fca3cc01eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:24.217012 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6062cc32-b8b6-4ef1-83ee-6fca3cc01eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1508 microversion: 2.1 time: 0.206676 Aug 22 17:29:24.217606 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 147/298] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:24 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:29:25.245950 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e74f37a1-d9ff-422c-b39a-b7a1959d6dcd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:25.246818 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e74f37a1-d9ff-422c-b39a-b7a1959d6dcd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:25.255489 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e74f37a1-d9ff-422c-b39a-b7a1959d6dcd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:25.256082 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e74f37a1-d9ff-422c-b39a-b7a1959d6dcd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:25.256573 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e74f37a1-d9ff-422c-b39a-b7a1959d6dcd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:25.257555 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e74f37a1-d9ff-422c-b39a-b7a1959d6dcd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:25.258135 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e74f37a1-d9ff-422c-b39a-b7a1959d6dcd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:25.258717 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e74f37a1-d9ff-422c-b39a-b7a1959d6dcd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:25.422424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e74f37a1-d9ff-422c-b39a-b7a1959d6dcd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:25.434789 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e74f37a1-d9ff-422c-b39a-b7a1959d6dcd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1508 microversion: 2.1 time: 0.197215 Aug 22 17:29:25.435483 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 152/299] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:25 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:29:26.465783 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-89c349d8-ed8a-4065-99bb-5483fbba495d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:26.468754 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-89c349d8-ed8a-4065-99bb-5483fbba495d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:26.480669 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89c349d8-ed8a-4065-99bb-5483fbba495d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:26.481773 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89c349d8-ed8a-4065-99bb-5483fbba495d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:26.482688 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89c349d8-ed8a-4065-99bb-5483fbba495d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:26.484092 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89c349d8-ed8a-4065-99bb-5483fbba495d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:26.485050 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89c349d8-ed8a-4065-99bb-5483fbba495d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:26.486212 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89c349d8-ed8a-4065-99bb-5483fbba495d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:26.493216 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:26.717477 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-89c349d8-ed8a-4065-99bb-5483fbba495d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:26.747191 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-89c349d8-ed8a-4065-99bb-5483fbba495d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1508 microversion: 2.1 time: 0.291617 Aug 22 17:29:26.750380 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 148/300] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:26 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1508 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:27.785677 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-76f7e134-d396-424d-86e5-b7ed98c1584b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:27.786645 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-76f7e134-d396-424d-86e5-b7ed98c1584b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:27.790711 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=30 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:27.800534 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-76f7e134-d396-424d-86e5-b7ed98c1584b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:27.801874 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-76f7e134-d396-424d-86e5-b7ed98c1584b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:27.802697 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-76f7e134-d396-424d-86e5-b7ed98c1584b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:27.803965 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-76f7e134-d396-424d-86e5-b7ed98c1584b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:27.804818 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-76f7e134-d396-424d-86e5-b7ed98c1584b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:27.805584 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-76f7e134-d396-424d-86e5-b7ed98c1584b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:27.971789 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-76f7e134-d396-424d-86e5-b7ed98c1584b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:27.980459 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-76f7e134-d396-424d-86e5-b7ed98c1584b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1514 microversion: 2.1 time: 0.203698 Aug 22 17:29:27.981056 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 153/301] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:27 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:30.975875 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-972addad-cc0b-4cc3-a2de-4271d4e3a592 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Action: 'create', calling method: .version_select at 0x7f0e5c87c9d0>, body: {"keypair": {"name": "tempest-keypair-526864827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9qoLxO2THfgsFr5X8bW4Av8/BvVRfrRXSQzkvxc/eyb+Ex9U0c8o1IMYMV5Rrb4tKrp4XSOg7BkGy0sN8POAF8epJwBqt8fcuBDbuPvmSmm3paQZ/F+JiE97lrA0b+rw=="}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:29:30.999963 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-972addad-cc0b-4cc3-a2de-4271d4e3a592 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Getting quotas for project de12c2563d50474cac799d50041a2fa0. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:29:31.005067 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-972addad-cc0b-4cc3-a2de-4271d4e3a592 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Getting quotas for user f46cbc7de18c4f9fb6f54e96be53fea0 and project de12c2563d50474cac799d50041a2fa0. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:29:31.195170 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-972addad-cc0b-4cc3-a2de-4271d4e3a592 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.227329 Aug 22 17:29:31.196503 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 149/302] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 22 17:29:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:29:34.424594 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1322421393", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e5a15b8-98bb-4b13-81ee-aec7a6ddff96"}], "security_groups": [{"name": "tempest-securitygroup--1677044777"}], "key_name": "tempest-keypair-526864827", "user_data": "}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:29:34.561575 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.network.neutron [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] validate_networks() for [('4e5a15b8-98bb-4b13-81ee-aec7a6ddff96', None, None, None, None, None)] {{(pid=121852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:29:35.078286 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Flavor limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:29:35.078814 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Image limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:29:35.079391 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Flavor pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:29:35.079846 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Image pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:29:35.080429 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:29:35.093104 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:35.098631 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:35.098631 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:35.098631 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:35.098631 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:35.099181 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:35.115513 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=72 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:35.136483 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Getting quotas for project de12c2563d50474cac799d50041a2fa0. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:29:35.142216 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Getting quotas for user f46cbc7de18c4f9fb6f54e96be53fea0 and project de12c2563d50474cac799d50041a2fa0. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:29:35.157187 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Going to run 1 instances... {{(pid=121852) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:29:35.160292 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:29:35.310615 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d90fad7f-a6ab-4124-9c73-e77ab28adc93 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.889826 Aug 22 17:29:35.311747 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 154/303] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:29:34 2022] POST /compute/v2.1/servers => generated 409 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:29:35.338739 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-dad737ea-4b21-42b4-bc02-b5cedd767d33 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:35.345659 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-dad737ea-4b21-42b4-bc02-b5cedd767d33 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:35.359019 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:35.464177 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-dad737ea-4b21-42b4-bc02-b5cedd767d33 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:35.475882 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-dad737ea-4b21-42b4-bc02-b5cedd767d33 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1245 microversion: 2.1 time: 0.150786 Aug 22 17:29:35.477287 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 150/304] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:35 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1245 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:36.511168 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0bbb3c2b-2d66-4be7-8e79-3fb5d1b19a80 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:36.511168 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0bbb3c2b-2d66-4be7-8e79-3fb5d1b19a80 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:36.522514 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bbb3c2b-2d66-4be7-8e79-3fb5d1b19a80 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:36.523436 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bbb3c2b-2d66-4be7-8e79-3fb5d1b19a80 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:36.524216 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bbb3c2b-2d66-4be7-8e79-3fb5d1b19a80 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:36.525484 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bbb3c2b-2d66-4be7-8e79-3fb5d1b19a80 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:36.526279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bbb3c2b-2d66-4be7-8e79-3fb5d1b19a80 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:36.527036 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bbb3c2b-2d66-4be7-8e79-3fb5d1b19a80 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:36.614181 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0bbb3c2b-2d66-4be7-8e79-3fb5d1b19a80 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:36.624001 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0bbb3c2b-2d66-4be7-8e79-3fb5d1b19a80 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1249 microversion: 2.1 time: 0.125275 Aug 22 17:29:36.624856 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 155/305] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:36 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1249 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:37.654414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6379a8de-d92b-40ed-80cc-1e22d276196b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:37.656751 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6379a8de-d92b-40ed-80cc-1e22d276196b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:37.687895 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6379a8de-d92b-40ed-80cc-1e22d276196b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:37.688528 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6379a8de-d92b-40ed-80cc-1e22d276196b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:37.689045 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6379a8de-d92b-40ed-80cc-1e22d276196b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:37.690564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6379a8de-d92b-40ed-80cc-1e22d276196b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:37.691560 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6379a8de-d92b-40ed-80cc-1e22d276196b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:37.691829 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6379a8de-d92b-40ed-80cc-1e22d276196b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:37.813590 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6379a8de-d92b-40ed-80cc-1e22d276196b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:37.826281 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6379a8de-d92b-40ed-80cc-1e22d276196b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1305 microversion: 2.1 time: 0.181418 Aug 22 17:29:37.827049 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 151/306] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:37 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1305 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:38.851846 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4fb0c83e-e50f-4414-89b8-ee301eb3e102 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:38.854574 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4fb0c83e-e50f-4414-89b8-ee301eb3e102 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:38.865446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4fb0c83e-e50f-4414-89b8-ee301eb3e102 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:38.866306 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4fb0c83e-e50f-4414-89b8-ee301eb3e102 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:38.867102 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4fb0c83e-e50f-4414-89b8-ee301eb3e102 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:38.868366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4fb0c83e-e50f-4414-89b8-ee301eb3e102 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:38.869128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4fb0c83e-e50f-4414-89b8-ee301eb3e102 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:38.869678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4fb0c83e-e50f-4414-89b8-ee301eb3e102 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:39.127600 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4fb0c83e-e50f-4414-89b8-ee301eb3e102 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:39.140588 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4fb0c83e-e50f-4414-89b8-ee301eb3e102 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.294389 Aug 22 17:29:39.141420 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 156/307] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:38 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:39.963259 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-5677306a-7824-4cff-afe2-6a0f4cef24aa req-0deeeed1-870a-449c-aff5-c644f0d166be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66347883-f0bf-4bbb-ba12-db82ee8d89c3", "tag": "c920306a-84f5-4723-a57f-bb8dc17b0207"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:29:39.984088 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-5677306a-7824-4cff-afe2-6a0f4cef24aa req-0deeeed1-870a-449c-aff5-c644f0d166be service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:39.985034 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-5677306a-7824-4cff-afe2-6a0f4cef24aa req-0deeeed1-870a-449c-aff5-c644f0d166be service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:39.985826 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-5677306a-7824-4cff-afe2-6a0f4cef24aa req-0deeeed1-870a-449c-aff5-c644f0d166be service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:40.006851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-5677306a-7824-4cff-afe2-6a0f4cef24aa req-0deeeed1-870a-449c-aff5-c644f0d166be service nova] Creating event network-changed:c920306a-84f5-4723-a57f-bb8dc17b0207 for instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 on hv-cinder-85394 Aug 22 17:29:40.014862 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-5677306a-7824-4cff-afe2-6a0f4cef24aa req-0deeeed1-870a-449c-aff5-c644f0d166be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057666 Aug 22 17:29:40.015474 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 152/308] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:29:40.165639 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2ae0bde6-9c45-4c79-bf95-ec304ce347ba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:40.168105 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-2ae0bde6-9c45-4c79-bf95-ec304ce347ba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:40.180809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ae0bde6-9c45-4c79-bf95-ec304ce347ba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:40.181729 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ae0bde6-9c45-4c79-bf95-ec304ce347ba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:40.182573 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ae0bde6-9c45-4c79-bf95-ec304ce347ba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:40.183933 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ae0bde6-9c45-4c79-bf95-ec304ce347ba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:40.184801 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ae0bde6-9c45-4c79-bf95-ec304ce347ba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:40.185596 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ae0bde6-9c45-4c79-bf95-ec304ce347ba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:40.367465 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2ae0bde6-9c45-4c79-bf95-ec304ce347ba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:40.386052 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2ae0bde6-9c45-4c79-bf95-ec304ce347ba tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.224010 Aug 22 17:29:40.387586 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 157/309] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:40 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:41.409671 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e3557296-b703-4dc0-8175-f1cd2ec72111 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:41.410367 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e3557296-b703-4dc0-8175-f1cd2ec72111 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:41.417151 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e3557296-b703-4dc0-8175-f1cd2ec72111 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:41.417644 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e3557296-b703-4dc0-8175-f1cd2ec72111 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:41.418089 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e3557296-b703-4dc0-8175-f1cd2ec72111 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:41.418851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e3557296-b703-4dc0-8175-f1cd2ec72111 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:41.419321 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e3557296-b703-4dc0-8175-f1cd2ec72111 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:41.419751 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e3557296-b703-4dc0-8175-f1cd2ec72111 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:41.615716 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e3557296-b703-4dc0-8175-f1cd2ec72111 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:41.626056 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e3557296-b703-4dc0-8175-f1cd2ec72111 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.220003 Aug 22 17:29:41.626414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 153/310] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:41 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:42.655048 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4162d1f2-b181-4270-a620-be926558a61c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:42.655673 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4162d1f2-b181-4270-a620-be926558a61c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:42.663476 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4162d1f2-b181-4270-a620-be926558a61c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:42.663978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4162d1f2-b181-4270-a620-be926558a61c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:42.664425 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4162d1f2-b181-4270-a620-be926558a61c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:42.665152 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4162d1f2-b181-4270-a620-be926558a61c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:42.665610 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4162d1f2-b181-4270-a620-be926558a61c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:42.666037 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4162d1f2-b181-4270-a620-be926558a61c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:42.841930 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4162d1f2-b181-4270-a620-be926558a61c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:42.852013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4162d1f2-b181-4270-a620-be926558a61c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.200838 Aug 22 17:29:42.852987 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 158/311] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:42 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:29:43.873607 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4e1186eb-fa6c-460c-b221-690fdec55806 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:43.874233 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4e1186eb-fa6c-460c-b221-690fdec55806 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:43.880610 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e1186eb-fa6c-460c-b221-690fdec55806 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:43.881094 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e1186eb-fa6c-460c-b221-690fdec55806 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:43.881522 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e1186eb-fa6c-460c-b221-690fdec55806 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:43.882213 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e1186eb-fa6c-460c-b221-690fdec55806 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:43.882687 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e1186eb-fa6c-460c-b221-690fdec55806 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:43.883105 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e1186eb-fa6c-460c-b221-690fdec55806 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:44.032300 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4e1186eb-fa6c-460c-b221-690fdec55806 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:44.044649 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4e1186eb-fa6c-460c-b221-690fdec55806 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.174971 Aug 22 17:29:44.045237 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 154/312] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:43 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:45.067761 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8ba073df-defc-41b5-947d-437588b734b7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:45.068551 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8ba073df-defc-41b5-947d-437588b734b7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:45.075920 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ba073df-defc-41b5-947d-437588b734b7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:45.076478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ba073df-defc-41b5-947d-437588b734b7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:45.077038 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ba073df-defc-41b5-947d-437588b734b7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:45.077870 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ba073df-defc-41b5-947d-437588b734b7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:45.078472 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ba073df-defc-41b5-947d-437588b734b7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:45.078989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ba073df-defc-41b5-947d-437588b734b7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:45.116446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:45.151769 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=6 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:45.245739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8ba073df-defc-41b5-947d-437588b734b7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:45.256003 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8ba073df-defc-41b5-947d-437588b734b7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.193380 Aug 22 17:29:45.256603 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 159/313] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:45 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:46.278537 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f266aff2-d834-4801-8702-fd2a7ab28cf2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:46.279183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f266aff2-d834-4801-8702-fd2a7ab28cf2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:46.281291 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=6 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:46.287175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f266aff2-d834-4801-8702-fd2a7ab28cf2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:46.287686 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f266aff2-d834-4801-8702-fd2a7ab28cf2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:46.288121 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f266aff2-d834-4801-8702-fd2a7ab28cf2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:46.288830 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f266aff2-d834-4801-8702-fd2a7ab28cf2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:46.289286 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f266aff2-d834-4801-8702-fd2a7ab28cf2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:46.289706 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f266aff2-d834-4801-8702-fd2a7ab28cf2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:46.454498 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f266aff2-d834-4801-8702-fd2a7ab28cf2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:46.463090 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f266aff2-d834-4801-8702-fd2a7ab28cf2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.189020 Aug 22 17:29:46.464668 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 155/314] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:46 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:29:47.485097 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-bd07caef-0765-4dfa-999c-6fa46a1ca832 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:47.485830 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-bd07caef-0765-4dfa-999c-6fa46a1ca832 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:47.495817 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd07caef-0765-4dfa-999c-6fa46a1ca832 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:47.496560 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd07caef-0765-4dfa-999c-6fa46a1ca832 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:47.497244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd07caef-0765-4dfa-999c-6fa46a1ca832 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:47.498340 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd07caef-0765-4dfa-999c-6fa46a1ca832 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:47.498976 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd07caef-0765-4dfa-999c-6fa46a1ca832 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:47.499503 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd07caef-0765-4dfa-999c-6fa46a1ca832 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:47.663294 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-bd07caef-0765-4dfa-999c-6fa46a1ca832 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:47.671788 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-bd07caef-0765-4dfa-999c-6fa46a1ca832 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.190565 Aug 22 17:29:47.672390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 160/315] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:47 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:48.709665 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2e5ecd78-8a3e-4ee7-bb17-c4689d69fb69 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:48.710758 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2e5ecd78-8a3e-4ee7-bb17-c4689d69fb69 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:48.722131 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e5ecd78-8a3e-4ee7-bb17-c4689d69fb69 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:48.723020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e5ecd78-8a3e-4ee7-bb17-c4689d69fb69 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:48.723768 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e5ecd78-8a3e-4ee7-bb17-c4689d69fb69 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:48.725057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e5ecd78-8a3e-4ee7-bb17-c4689d69fb69 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:48.725933 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e5ecd78-8a3e-4ee7-bb17-c4689d69fb69 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:48.726698 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e5ecd78-8a3e-4ee7-bb17-c4689d69fb69 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:48.888148 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2e5ecd78-8a3e-4ee7-bb17-c4689d69fb69 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:48.901619 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2e5ecd78-8a3e-4ee7-bb17-c4689d69fb69 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.200453 Aug 22 17:29:48.902364 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 156/316] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:48 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:49.924655 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e15de8f1-5edf-4020-b7a6-f4095944cff2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:49.926405 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e15de8f1-5edf-4020-b7a6-f4095944cff2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:49.934081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e15de8f1-5edf-4020-b7a6-f4095944cff2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:49.934613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e15de8f1-5edf-4020-b7a6-f4095944cff2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:49.935060 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e15de8f1-5edf-4020-b7a6-f4095944cff2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:49.935883 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e15de8f1-5edf-4020-b7a6-f4095944cff2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:49.936322 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e15de8f1-5edf-4020-b7a6-f4095944cff2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:49.936777 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e15de8f1-5edf-4020-b7a6-f4095944cff2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:50.097537 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e15de8f1-5edf-4020-b7a6-f4095944cff2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:50.105944 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e15de8f1-5edf-4020-b7a6-f4095944cff2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.186404 Aug 22 17:29:50.106547 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 161/317] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:49 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:29:51.128454 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1dac9a7d-b7b1-4ab1-a2ca-f9794f46113f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:51.129083 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1dac9a7d-b7b1-4ab1-a2ca-f9794f46113f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:51.136827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1dac9a7d-b7b1-4ab1-a2ca-f9794f46113f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:51.137597 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1dac9a7d-b7b1-4ab1-a2ca-f9794f46113f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:51.138657 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1dac9a7d-b7b1-4ab1-a2ca-f9794f46113f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:51.139736 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1dac9a7d-b7b1-4ab1-a2ca-f9794f46113f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:51.140254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1dac9a7d-b7b1-4ab1-a2ca-f9794f46113f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:51.140750 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1dac9a7d-b7b1-4ab1-a2ca-f9794f46113f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:51.299175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1dac9a7d-b7b1-4ab1-a2ca-f9794f46113f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:51.308006 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1dac9a7d-b7b1-4ab1-a2ca-f9794f46113f tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.183888 Aug 22 17:29:51.308766 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 157/318] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:51 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:52.341995 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e94515f5-3a02-4496-898c-e789a4b7076e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:52.342729 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e94515f5-3a02-4496-898c-e789a4b7076e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:52.350548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e94515f5-3a02-4496-898c-e789a4b7076e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:52.351043 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e94515f5-3a02-4496-898c-e789a4b7076e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:52.351485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e94515f5-3a02-4496-898c-e789a4b7076e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:52.352195 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e94515f5-3a02-4496-898c-e789a4b7076e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:52.352665 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e94515f5-3a02-4496-898c-e789a4b7076e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:52.353086 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e94515f5-3a02-4496-898c-e789a4b7076e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:52.500869 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e94515f5-3a02-4496-898c-e789a4b7076e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:52.510403 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e94515f5-3a02-4496-898c-e789a4b7076e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.172477 Aug 22 17:29:52.511065 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 162/319] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:52 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:53.545521 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d95fac2e-537d-45f4-9030-e843960f1fa6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:53.546127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d95fac2e-537d-45f4-9030-e843960f1fa6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:53.555180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d95fac2e-537d-45f4-9030-e843960f1fa6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:53.556039 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d95fac2e-537d-45f4-9030-e843960f1fa6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:53.556813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d95fac2e-537d-45f4-9030-e843960f1fa6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:53.558113 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d95fac2e-537d-45f4-9030-e843960f1fa6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:53.558979 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d95fac2e-537d-45f4-9030-e843960f1fa6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:53.559818 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d95fac2e-537d-45f4-9030-e843960f1fa6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:53.710263 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d95fac2e-537d-45f4-9030-e843960f1fa6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:53.718800 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d95fac2e-537d-45f4-9030-e843960f1fa6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.177105 Aug 22 17:29:53.719584 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 158/320] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:53 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:54.742073 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d3c51f93-7192-4759-8d39-f4f683092b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:54.742968 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d3c51f93-7192-4759-8d39-f4f683092b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:54.749697 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d3c51f93-7192-4759-8d39-f4f683092b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:54.750206 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d3c51f93-7192-4759-8d39-f4f683092b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:54.750671 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d3c51f93-7192-4759-8d39-f4f683092b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:54.751379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d3c51f93-7192-4759-8d39-f4f683092b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:54.752470 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d3c51f93-7192-4759-8d39-f4f683092b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:54.753157 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d3c51f93-7192-4759-8d39-f4f683092b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:54.906107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-d3c51f93-7192-4759-8d39-f4f683092b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:54.915261 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d3c51f93-7192-4759-8d39-f4f683092b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.177120 Aug 22 17:29:54.915872 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 163/321] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:54 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:55.937181 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-9dacd9fa-529f-4d37-88ad-3a03982c9cd5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:55.937851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9dacd9fa-529f-4d37-88ad-3a03982c9cd5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:55.945608 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9dacd9fa-529f-4d37-88ad-3a03982c9cd5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:55.946103 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9dacd9fa-529f-4d37-88ad-3a03982c9cd5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:55.946578 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9dacd9fa-529f-4d37-88ad-3a03982c9cd5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:55.947299 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9dacd9fa-529f-4d37-88ad-3a03982c9cd5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:55.947784 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9dacd9fa-529f-4d37-88ad-3a03982c9cd5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:55.948212 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9dacd9fa-529f-4d37-88ad-3a03982c9cd5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:56.110356 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-9dacd9fa-529f-4d37-88ad-3a03982c9cd5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:56.125979 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-9dacd9fa-529f-4d37-88ad-3a03982c9cd5 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.192369 Aug 22 17:29:56.130709 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 159/322] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:55 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:29:57.162864 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-aad50836-8426-4e7a-8b43-459088ebd9b1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:57.163605 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-aad50836-8426-4e7a-8b43-459088ebd9b1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:57.170770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aad50836-8426-4e7a-8b43-459088ebd9b1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:57.171261 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aad50836-8426-4e7a-8b43-459088ebd9b1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:57.171697 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aad50836-8426-4e7a-8b43-459088ebd9b1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:57.172411 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aad50836-8426-4e7a-8b43-459088ebd9b1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:57.172859 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aad50836-8426-4e7a-8b43-459088ebd9b1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:57.173287 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aad50836-8426-4e7a-8b43-459088ebd9b1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:57.357278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-aad50836-8426-4e7a-8b43-459088ebd9b1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:57.366681 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-aad50836-8426-4e7a-8b43-459088ebd9b1 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.208257 Aug 22 17:29:57.367280 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 164/323] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:57 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:29:57.674661 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-05dfcc7d-e50d-4129-8491-30685093cb8a req-537c0578-d15f-4bcb-8954-872e6d49ae56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66347883-f0bf-4bbb-ba12-db82ee8d89c3", "name": "network-vif-plugged", "status": "completed", "tag": "c920306a-84f5-4723-a57f-bb8dc17b0207"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:29:57.688093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-05dfcc7d-e50d-4129-8491-30685093cb8a req-537c0578-d15f-4bcb-8954-872e6d49ae56 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:57.688573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-05dfcc7d-e50d-4129-8491-30685093cb8a req-537c0578-d15f-4bcb-8954-872e6d49ae56 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:57.688999 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-05dfcc7d-e50d-4129-8491-30685093cb8a req-537c0578-d15f-4bcb-8954-872e6d49ae56 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:57.701681 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-05dfcc7d-e50d-4129-8491-30685093cb8a req-537c0578-d15f-4bcb-8954-872e6d49ae56 service nova] Creating event network-vif-plugged:c920306a-84f5-4723-a57f-bb8dc17b0207 for instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 on hv-cinder-85394 Aug 22 17:29:57.710371 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-05dfcc7d-e50d-4129-8491-30685093cb8a req-537c0578-d15f-4bcb-8954-872e6d49ae56 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040639 Aug 22 17:29:57.710371 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 160/324] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:29:58.389631 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b8c8b40a-a66d-4ca6-9b8a-12cb2adbe9c0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:58.390722 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b8c8b40a-a66d-4ca6-9b8a-12cb2adbe9c0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:58.394218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:29:58.404297 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b8c8b40a-a66d-4ca6-9b8a-12cb2adbe9c0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:58.405009 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b8c8b40a-a66d-4ca6-9b8a-12cb2adbe9c0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:58.405677 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b8c8b40a-a66d-4ca6-9b8a-12cb2adbe9c0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:58.407182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b8c8b40a-a66d-4ca6-9b8a-12cb2adbe9c0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:58.408071 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b8c8b40a-a66d-4ca6-9b8a-12cb2adbe9c0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:58.409578 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b8c8b40a-a66d-4ca6-9b8a-12cb2adbe9c0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:58.595971 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b8c8b40a-a66d-4ca6-9b8a-12cb2adbe9c0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:58.604732 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b8c8b40a-a66d-4ca6-9b8a-12cb2adbe9c0 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.220287 Aug 22 17:29:58.607557 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 165/325] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:58 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:29:59.627422 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-803e4e80-57c0-4522-8ae5-bbf639ac6974 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:29:59.628179 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-803e4e80-57c0-4522-8ae5-bbf639ac6974 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:29:59.634998 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-803e4e80-57c0-4522-8ae5-bbf639ac6974 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:59.635488 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-803e4e80-57c0-4522-8ae5-bbf639ac6974 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:59.635928 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-803e4e80-57c0-4522-8ae5-bbf639ac6974 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:59.636650 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-803e4e80-57c0-4522-8ae5-bbf639ac6974 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:29:59.637106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-803e4e80-57c0-4522-8ae5-bbf639ac6974 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:29:59.637532 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-803e4e80-57c0-4522-8ae5-bbf639ac6974 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:29:59.795308 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-803e4e80-57c0-4522-8ae5-bbf639ac6974 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:29:59.804442 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-803e4e80-57c0-4522-8ae5-bbf639ac6974 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1371 microversion: 2.1 time: 0.181472 Aug 22 17:29:59.805679 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 161/326] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:29:59 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:30:00.829357 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d2ca5b77-3535-4065-b271-496f243281c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:30:00.830102 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d2ca5b77-3535-4065-b271-496f243281c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:30:00.838075 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d2ca5b77-3535-4065-b271-496f243281c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:30:00.838603 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d2ca5b77-3535-4065-b271-496f243281c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:30:00.839051 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d2ca5b77-3535-4065-b271-496f243281c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:30:00.839859 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d2ca5b77-3535-4065-b271-496f243281c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:30:00.840329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d2ca5b77-3535-4065-b271-496f243281c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:30:00.840838 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d2ca5b77-3535-4065-b271-496f243281c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:30:00.998708 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-d2ca5b77-3535-4065-b271-496f243281c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:30:01.007401 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d2ca5b77-3535-4065-b271-496f243281c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1566 microversion: 2.1 time: 0.182445 Aug 22 17:30:01.008032 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 166/327] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:30:00 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:30:01.029934 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-567755e9-9822-45ae-a88f-283780d17048 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:30:01.030654 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-567755e9-9822-45ae-a88f-283780d17048 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:30:01.039115 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-567755e9-9822-45ae-a88f-283780d17048 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:30:01.039651 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-567755e9-9822-45ae-a88f-283780d17048 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:30:01.040122 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-567755e9-9822-45ae-a88f-283780d17048 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:30:01.040884 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-567755e9-9822-45ae-a88f-283780d17048 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:30:01.041472 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-567755e9-9822-45ae-a88f-283780d17048 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:30:01.041992 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-567755e9-9822-45ae-a88f-283780d17048 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:30:01.134471 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-567755e9-9822-45ae-a88f-283780d17048 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108282 Aug 22 17:30:01.135680 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 162/328] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 22 17:30:01 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-interface => generated 285 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:30:02.583368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-0a5274da-cefd-4437-95b5-2f4b25faefd6 req-baac1003-3e9e-4ad0-a849-f5393e8e3dd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66347883-f0bf-4bbb-ba12-db82ee8d89c3", "tag": "c920306a-84f5-4723-a57f-bb8dc17b0207"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:30:02.602570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-0a5274da-cefd-4437-95b5-2f4b25faefd6 req-baac1003-3e9e-4ad0-a849-f5393e8e3dd5 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:30:02.603438 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-0a5274da-cefd-4437-95b5-2f4b25faefd6 req-baac1003-3e9e-4ad0-a849-f5393e8e3dd5 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:30:02.604210 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-0a5274da-cefd-4437-95b5-2f4b25faefd6 req-baac1003-3e9e-4ad0-a849-f5393e8e3dd5 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:30:02.627736 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-0a5274da-cefd-4437-95b5-2f4b25faefd6 req-baac1003-3e9e-4ad0-a849-f5393e8e3dd5 service nova] Creating event network-changed:c920306a-84f5-4723-a57f-bb8dc17b0207 for instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 on hv-cinder-85394 Aug 22 17:30:02.637631 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-0a5274da-cefd-4437-95b5-2f4b25faefd6 req-baac1003-3e9e-4ad0-a849-f5393e8e3dd5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061418 Aug 22 17:30:02.639042 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 167/329] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:30:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:30:12.510346 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:30:12.511051 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Mon Aug 22 17:30:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:31:07.854386 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=27 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:07.856841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=67 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:07.863195 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-fd54f25f-cdd3-4d84-81ac-9bdc48198a7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:07.863956 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-fd54f25f-cdd3-4d84-81ac-9bdc48198a7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:07.877378 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd54f25f-cdd3-4d84-81ac-9bdc48198a7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:07.878220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd54f25f-cdd3-4d84-81ac-9bdc48198a7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:07.878839 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd54f25f-cdd3-4d84-81ac-9bdc48198a7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:07.879874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd54f25f-cdd3-4d84-81ac-9bdc48198a7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:07.880456 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd54f25f-cdd3-4d84-81ac-9bdc48198a7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:07.881017 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd54f25f-cdd3-4d84-81ac-9bdc48198a7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:07.935986 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-fd54f25f-cdd3-4d84-81ac-9bdc48198a7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/ips" status: 200 len: 151 microversion: 2.20 time: 0.083677 Aug 22 17:31:07.936742 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 163/330] 10.222.0.20 () {60 vars in 1289 bytes} [Mon Aug 22 17:31:07 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/ips => generated 151 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:31:09.465348 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=5 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:09.467653 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=75 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:09.476394 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8ea27cc0-7666-4554-afa9-c43c83af196f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:09.477555 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8ea27cc0-7666-4554-afa9-c43c83af196f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:09.488774 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ea27cc0-7666-4554-afa9-c43c83af196f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:09.490028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ea27cc0-7666-4554-afa9-c43c83af196f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:09.491272 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ea27cc0-7666-4554-afa9-c43c83af196f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:09.492834 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ea27cc0-7666-4554-afa9-c43c83af196f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:09.495092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ea27cc0-7666-4554-afa9-c43c83af196f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:09.495832 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ea27cc0-7666-4554-afa9-c43c83af196f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:09.545986 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8ea27cc0-7666-4554-afa9-c43c83af196f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516/ips" status: 200 len: 148 microversion: 2.1 time: 0.076893 Aug 22 17:31:09.545986 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 168/331] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 22 17:31:09 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516/ips => generated 148 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:31:11.783728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6da22550-5a61-4b1e-a680-893170864a94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:11.784342 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6da22550-5a61-4b1e-a680-893170864a94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:11.791137 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6da22550-5a61-4b1e-a680-893170864a94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:11.791596 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6da22550-5a61-4b1e-a680-893170864a94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:11.792030 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6da22550-5a61-4b1e-a680-893170864a94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:11.792763 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6da22550-5a61-4b1e-a680-893170864a94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:11.793214 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6da22550-5a61-4b1e-a680-893170864a94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:11.793634 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6da22550-5a61-4b1e-a680-893170864a94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:11.827154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-6da22550-5a61-4b1e-a680-893170864a94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lazy-loading 'flavor' on Instance uuid fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:31:12.440582 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6da22550-5a61-4b1e-a680-893170864a94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "POST /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/action" status: 202 len: 0 microversion: 2.20 time: 0.661446 Aug 22 17:31:12.441447 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 164/332] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 22 17:31:11 2022] POST /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/action => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 22 17:31:12.452439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-759f825b-115d-41a5-afa4-d1866aac1944 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:12.453807 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-759f825b-115d-41a5-afa4-d1866aac1944 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:12.461671 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-759f825b-115d-41a5-afa4-d1866aac1944 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:12.462060 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-759f825b-115d-41a5-afa4-d1866aac1944 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:12.462532 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-759f825b-115d-41a5-afa4-d1866aac1944 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:12.463283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-759f825b-115d-41a5-afa4-d1866aac1944 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:12.463739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-759f825b-115d-41a5-afa4-d1866aac1944 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:12.464170 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-759f825b-115d-41a5-afa4-d1866aac1944 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:12.666070 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-759f825b-115d-41a5-afa4-d1866aac1944 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:12.685791 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-759f825b-115d-41a5-afa4-d1866aac1944 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:12.685791 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-759f825b-115d-41a5-afa4-d1866aac1944 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:12.685791 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-759f825b-115d-41a5-afa4-d1866aac1944 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.238793 Aug 22 17:31:12.694087 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 169/333] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:12 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:12.713708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-93ae3eda-c930-47ee-95e4-6ab6e8ed188d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4892817e-866b-4e98-b1aa-ecdca6121d4d"}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:12.717937 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-93ae3eda-c930-47ee-95e4-6ab6e8ed188d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:12.739385 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-93ae3eda-c930-47ee-95e4-6ab6e8ed188d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:12.740710 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-93ae3eda-c930-47ee-95e4-6ab6e8ed188d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:12.742342 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-93ae3eda-c930-47ee-95e4-6ab6e8ed188d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:12.743975 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-93ae3eda-c930-47ee-95e4-6ab6e8ed188d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:12.745044 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-93ae3eda-c930-47ee-95e4-6ab6e8ed188d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:12.746029 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-93ae3eda-c930-47ee-95e4-6ab6e8ed188d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:13.585070 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-93ae3eda-c930-47ee-95e4-6ab6e8ed188d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "POST /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.879511 Aug 22 17:31:13.585982 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 165/334] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 22 17:31:12 2022] POST /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516/os-volume_attachments => generated 194 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:31:13.720218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-72fa1302-add5-466b-bb93-51c20e8d5e6b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:13.720892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-72fa1302-add5-466b-bb93-51c20e8d5e6b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:13.728009 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72fa1302-add5-466b-bb93-51c20e8d5e6b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:13.728504 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72fa1302-add5-466b-bb93-51c20e8d5e6b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:13.728942 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72fa1302-add5-466b-bb93-51c20e8d5e6b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:13.729658 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72fa1302-add5-466b-bb93-51c20e8d5e6b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:13.730115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72fa1302-add5-466b-bb93-51c20e8d5e6b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:13.730771 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72fa1302-add5-466b-bb93-51c20e8d5e6b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:13.923298 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-72fa1302-add5-466b-bb93-51c20e8d5e6b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:13.932724 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-72fa1302-add5-466b-bb93-51c20e8d5e6b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:13.934296 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-72fa1302-add5-466b-bb93-51c20e8d5e6b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:13.935623 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-72fa1302-add5-466b-bb93-51c20e8d5e6b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.220492 Aug 22 17:31:13.936497 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 170/335] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:13 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:14.971503 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2770bff2-f465-4630-8e35-62727656f7d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:14.972655 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2770bff2-f465-4630-8e35-62727656f7d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:14.983620 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2770bff2-f465-4630-8e35-62727656f7d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:14.985782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2770bff2-f465-4630-8e35-62727656f7d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:14.986546 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2770bff2-f465-4630-8e35-62727656f7d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:14.987740 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2770bff2-f465-4630-8e35-62727656f7d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:14.988507 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2770bff2-f465-4630-8e35-62727656f7d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:14.989107 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2770bff2-f465-4630-8e35-62727656f7d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:15.189874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2770bff2-f465-4630-8e35-62727656f7d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:15.198440 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2770bff2-f465-4630-8e35-62727656f7d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:15.200195 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2770bff2-f465-4630-8e35-62727656f7d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:15.201400 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2770bff2-f465-4630-8e35-62727656f7d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.240246 Aug 22 17:31:15.202007 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 166/336] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:14 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:16.225034 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-1e411b3c-b31b-4249-b2e7-086b73f0327a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:16.225757 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-1e411b3c-b31b-4249-b2e7-086b73f0327a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:16.233004 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1e411b3c-b31b-4249-b2e7-086b73f0327a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:16.233499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1e411b3c-b31b-4249-b2e7-086b73f0327a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:16.234619 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1e411b3c-b31b-4249-b2e7-086b73f0327a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:16.235297 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1e411b3c-b31b-4249-b2e7-086b73f0327a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:16.235844 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1e411b3c-b31b-4249-b2e7-086b73f0327a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:16.236512 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1e411b3c-b31b-4249-b2e7-086b73f0327a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:16.456934 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-1e411b3c-b31b-4249-b2e7-086b73f0327a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:16.467793 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-1e411b3c-b31b-4249-b2e7-086b73f0327a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:16.470308 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-1e411b3c-b31b-4249-b2e7-086b73f0327a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:16.471836 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-1e411b3c-b31b-4249-b2e7-086b73f0327a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.250762 Aug 22 17:31:16.472667 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 171/337] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:16 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:17.501792 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-522e3a84-0a44-4414-bcf6-c5311f61f2ef tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:17.503237 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-522e3a84-0a44-4414-bcf6-c5311f61f2ef tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:17.510518 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-522e3a84-0a44-4414-bcf6-c5311f61f2ef tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:17.514063 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-522e3a84-0a44-4414-bcf6-c5311f61f2ef tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:17.514063 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-522e3a84-0a44-4414-bcf6-c5311f61f2ef tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:17.514063 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-522e3a84-0a44-4414-bcf6-c5311f61f2ef tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:17.514868 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-522e3a84-0a44-4414-bcf6-c5311f61f2ef tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:17.516092 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-522e3a84-0a44-4414-bcf6-c5311f61f2ef tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:17.704300 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-522e3a84-0a44-4414-bcf6-c5311f61f2ef tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:17.713349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-522e3a84-0a44-4414-bcf6-c5311f61f2ef tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:17.714902 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-522e3a84-0a44-4414-bcf6-c5311f61f2ef tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:17.716852 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-522e3a84-0a44-4414-bcf6-c5311f61f2ef tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.220232 Aug 22 17:31:17.717437 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 167/338] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:17 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:18.741665 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-87e0432f-2307-4dbc-b7b4-a874ee457d43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:18.742344 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-87e0432f-2307-4dbc-b7b4-a874ee457d43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:18.749289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87e0432f-2307-4dbc-b7b4-a874ee457d43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:18.749770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87e0432f-2307-4dbc-b7b4-a874ee457d43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:18.750218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87e0432f-2307-4dbc-b7b4-a874ee457d43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:18.750983 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87e0432f-2307-4dbc-b7b4-a874ee457d43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:18.751438 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87e0432f-2307-4dbc-b7b4-a874ee457d43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:18.752223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-87e0432f-2307-4dbc-b7b4-a874ee457d43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:19.154848 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-87e0432f-2307-4dbc-b7b4-a874ee457d43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:19.166169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-87e0432f-2307-4dbc-b7b4-a874ee457d43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:19.167840 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-87e0432f-2307-4dbc-b7b4-a874ee457d43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:19.169373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-87e0432f-2307-4dbc-b7b4-a874ee457d43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.431746 Aug 22 17:31:19.169952 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 172/339] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:18 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:20.208943 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a3181342-d98a-49aa-b940-42f0495b2ae8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:20.209655 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a3181342-d98a-49aa-b940-42f0495b2ae8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:20.216717 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a3181342-d98a-49aa-b940-42f0495b2ae8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:20.217319 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a3181342-d98a-49aa-b940-42f0495b2ae8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:20.217795 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a3181342-d98a-49aa-b940-42f0495b2ae8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:20.219675 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a3181342-d98a-49aa-b940-42f0495b2ae8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:20.220194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a3181342-d98a-49aa-b940-42f0495b2ae8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:20.220674 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a3181342-d98a-49aa-b940-42f0495b2ae8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:20.394222 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a3181342-d98a-49aa-b940-42f0495b2ae8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:20.403505 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a3181342-d98a-49aa-b940-42f0495b2ae8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:20.405077 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a3181342-d98a-49aa-b940-42f0495b2ae8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:20.406373 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a3181342-d98a-49aa-b940-42f0495b2ae8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.201511 Aug 22 17:31:20.407032 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 168/340] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:20 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:21.431363 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-73f0aa07-527e-4860-99a0-0caf9548de20 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:21.432017 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-73f0aa07-527e-4860-99a0-0caf9548de20 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:21.440545 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-73f0aa07-527e-4860-99a0-0caf9548de20 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:21.441094 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-73f0aa07-527e-4860-99a0-0caf9548de20 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:21.441575 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-73f0aa07-527e-4860-99a0-0caf9548de20 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:21.442333 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-73f0aa07-527e-4860-99a0-0caf9548de20 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:21.443056 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-73f0aa07-527e-4860-99a0-0caf9548de20 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:21.443570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-73f0aa07-527e-4860-99a0-0caf9548de20 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:21.614514 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-73f0aa07-527e-4860-99a0-0caf9548de20 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:21.625576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-73f0aa07-527e-4860-99a0-0caf9548de20 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:21.627330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-73f0aa07-527e-4860-99a0-0caf9548de20 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:21.628714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-73f0aa07-527e-4860-99a0-0caf9548de20 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.201446 Aug 22 17:31:21.629306 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 173/341] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:21 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:22.653155 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2fbb7473-9449-460c-bf85-8d6759236844 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:22.653803 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2fbb7473-9449-460c-bf85-8d6759236844 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:22.661453 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2fbb7473-9449-460c-bf85-8d6759236844 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:22.661932 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2fbb7473-9449-460c-bf85-8d6759236844 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:22.662423 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2fbb7473-9449-460c-bf85-8d6759236844 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:22.663168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2fbb7473-9449-460c-bf85-8d6759236844 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:22.663627 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2fbb7473-9449-460c-bf85-8d6759236844 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:22.664052 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2fbb7473-9449-460c-bf85-8d6759236844 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:22.829700 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2fbb7473-9449-460c-bf85-8d6759236844 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:22.839118 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2fbb7473-9449-460c-bf85-8d6759236844 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:22.840658 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2fbb7473-9449-460c-bf85-8d6759236844 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:22.841875 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2fbb7473-9449-460c-bf85-8d6759236844 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.193152 Aug 22 17:31:22.842605 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 169/342] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:22 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:31:23.869298 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a5b55360-2f4e-4bbe-aaf1-1d0ab30d1763 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:23.870190 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a5b55360-2f4e-4bbe-aaf1-1d0ab30d1763 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:23.876804 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a5b55360-2f4e-4bbe-aaf1-1d0ab30d1763 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:23.877298 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a5b55360-2f4e-4bbe-aaf1-1d0ab30d1763 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:23.877740 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a5b55360-2f4e-4bbe-aaf1-1d0ab30d1763 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:23.878462 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a5b55360-2f4e-4bbe-aaf1-1d0ab30d1763 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:23.878951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a5b55360-2f4e-4bbe-aaf1-1d0ab30d1763 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:23.879373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a5b55360-2f4e-4bbe-aaf1-1d0ab30d1763 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:24.053561 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a5b55360-2f4e-4bbe-aaf1-1d0ab30d1763 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:24.069031 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a5b55360-2f4e-4bbe-aaf1-1d0ab30d1763 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:24.072422 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a5b55360-2f4e-4bbe-aaf1-1d0ab30d1763 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:24.074735 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a5b55360-2f4e-4bbe-aaf1-1d0ab30d1763 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.209226 Aug 22 17:31:24.075837 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 174/343] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:23 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:24.477879 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0855149c-dcdf-4690-983d-b92b5c4b00b2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Action: 'create', calling method: .version_select at 0x7f0e5c7a50d0>, body: {"keypair": {"name": "tempest-keypair-325505628", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK2QYOITCDzrUGa7LhwPf0tz1YdNIt7WFM4AcdQ8KfyeBDKg8cDVv5jjxiLSq7t07gbKb0nx239EBXViF62iAQKz5Cca9DYaikO2tyHhTOVQbvimKKkM3gDC1zygyMp58A=="}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:24.496172 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-0855149c-dcdf-4690-983d-b92b5c4b00b2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for project 6436020e938047408d1f979e23dd48da. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:31:24.501675 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-0855149c-dcdf-4690-983d-b92b5c4b00b2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for user b0db362075b04b2294a6268576a5bba3 and project 6436020e938047408d1f979e23dd48da. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:31:24.609311 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0855149c-dcdf-4690-983d-b92b5c4b00b2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.135669 Aug 22 17:31:24.610193 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 170/344] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 22 17:31:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:31:25.105994 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-10949867-c901-4821-a9d9-49d63540d93b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:25.107185 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-10949867-c901-4821-a9d9-49d63540d93b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:25.121439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-10949867-c901-4821-a9d9-49d63540d93b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:25.122196 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-10949867-c901-4821-a9d9-49d63540d93b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:25.122999 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-10949867-c901-4821-a9d9-49d63540d93b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:25.124972 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-10949867-c901-4821-a9d9-49d63540d93b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:25.125840 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-10949867-c901-4821-a9d9-49d63540d93b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:25.126660 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-10949867-c901-4821-a9d9-49d63540d93b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:25.339204 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-10949867-c901-4821-a9d9-49d63540d93b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:25.355914 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-10949867-c901-4821-a9d9-49d63540d93b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:25.360837 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-10949867-c901-4821-a9d9-49d63540d93b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:25.363104 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-10949867-c901-4821-a9d9-49d63540d93b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.264762 Aug 22 17:31:25.364214 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 175/345] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:25 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:26.408184 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ee60215e-8e38-4209-b51d-2259caf79259 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:26.409577 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ee60215e-8e38-4209-b51d-2259caf79259 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:26.424436 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ee60215e-8e38-4209-b51d-2259caf79259 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:26.425325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ee60215e-8e38-4209-b51d-2259caf79259 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:26.426156 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ee60215e-8e38-4209-b51d-2259caf79259 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:26.427615 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ee60215e-8e38-4209-b51d-2259caf79259 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:26.428413 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ee60215e-8e38-4209-b51d-2259caf79259 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:26.429175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ee60215e-8e38-4209-b51d-2259caf79259 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:26.688499 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ee60215e-8e38-4209-b51d-2259caf79259 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:26.704296 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ee60215e-8e38-4209-b51d-2259caf79259 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:26.705842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ee60215e-8e38-4209-b51d-2259caf79259 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:26.707103 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ee60215e-8e38-4209-b51d-2259caf79259 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.307413 Aug 22 17:31:26.710117 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 171/346] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:26 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:31:27.746410 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-158cb56e-8416-4d9a-9ce2-982cd6929e36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:27.747978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-158cb56e-8416-4d9a-9ce2-982cd6929e36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:27.756262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-158cb56e-8416-4d9a-9ce2-982cd6929e36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:27.756855 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-158cb56e-8416-4d9a-9ce2-982cd6929e36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:27.757301 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-158cb56e-8416-4d9a-9ce2-982cd6929e36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:27.758057 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-158cb56e-8416-4d9a-9ce2-982cd6929e36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:27.758553 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-158cb56e-8416-4d9a-9ce2-982cd6929e36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:27.759242 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-158cb56e-8416-4d9a-9ce2-982cd6929e36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:27.910851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2071680376", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab7e148b-b163-4e14-9626-bb3c240fc395"}], "security_groups": [{"name": "tempest-securitygroup--1560486408"}], "key_name": "tempest-keypair-325505628", "user_data": "}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:27.928832 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-158cb56e-8416-4d9a-9ce2-982cd6929e36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:27.942713 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-158cb56e-8416-4d9a-9ce2-982cd6929e36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:27.945909 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-158cb56e-8416-4d9a-9ce2-982cd6929e36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:27.948430 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-158cb56e-8416-4d9a-9ce2-982cd6929e36 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.205254 Aug 22 17:31:27.948615 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 176/347] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:27 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:28.320399 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.network.neutron [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] validate_networks() for [('ab7e148b-b163-4e14-9626-bb3c240fc395', None, None, None, None, None)] {{(pid=121853) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:31:28.890763 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Flavor limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:31:28.891699 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Image limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:31:28.893606 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Flavor pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:31:28.894071 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Image pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:31:28.895084 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:31:28.925486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:28.925486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:28.925486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:28.925486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:28.926342 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:28.926342 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:28.948727 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for project 6436020e938047408d1f979e23dd48da. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:31:28.957125 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for user b0db362075b04b2294a6268576a5bba3 and project 6436020e938047408d1f979e23dd48da. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:31:28.972333 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-88c1b5f5-25b3-48f8-9bdc-b4c6fddee1e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:28.973636 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-88c1b5f5-25b3-48f8-9bdc-b4c6fddee1e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:28.978411 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Going to run 1 instances... {{(pid=121853) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:31:28.980837 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-88c1b5f5-25b3-48f8-9bdc-b4c6fddee1e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:28.981452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-88c1b5f5-25b3-48f8-9bdc-b4c6fddee1e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:28.981893 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-88c1b5f5-25b3-48f8-9bdc-b4c6fddee1e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:28.982634 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-88c1b5f5-25b3-48f8-9bdc-b4c6fddee1e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:28.982986 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:31:28.983120 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-88c1b5f5-25b3-48f8-9bdc-b4c6fddee1e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:28.984015 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-88c1b5f5-25b3-48f8-9bdc-b4c6fddee1e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:29.144477 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-88c1b5f5-25b3-48f8-9bdc-b4c6fddee1e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:29.153993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-88c1b5f5-25b3-48f8-9bdc-b4c6fddee1e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:29.156180 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-88c1b5f5-25b3-48f8-9bdc-b4c6fddee1e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:29.162836 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-88c1b5f5-25b3-48f8-9bdc-b4c6fddee1e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.194306 Aug 22 17:31:29.164170 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 177/348] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:28 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:31:29.200170 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1ec08ee9-e055-492f-b078-a43fff29738f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.294446 Aug 22 17:31:29.201580 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 172/349] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:31:27 2022] POST /compute/v2.1/servers => generated 402 bytes in 1297 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 17:31:29.220564 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-105d3aee-9e30-4e90-85f7-6e0ed7316002 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:29.221288 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-105d3aee-9e30-4e90-85f7-6e0ed7316002 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:29.303241 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-105d3aee-9e30-4e90-85f7-6e0ed7316002 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:29.311791 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-105d3aee-9e30-4e90-85f7-6e0ed7316002 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1241 microversion: 2.1 time: 0.097161 Aug 22 17:31:29.312783 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 178/350] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:29 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:30.189208 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1afd61b6-b211-413f-980e-5bd53ced19f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:30.189828 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1afd61b6-b211-413f-980e-5bd53ced19f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:30.200111 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1afd61b6-b211-413f-980e-5bd53ced19f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:30.200772 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1afd61b6-b211-413f-980e-5bd53ced19f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:30.201310 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1afd61b6-b211-413f-980e-5bd53ced19f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:30.202752 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1afd61b6-b211-413f-980e-5bd53ced19f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:30.203352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1afd61b6-b211-413f-980e-5bd53ced19f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:30.203885 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1afd61b6-b211-413f-980e-5bd53ced19f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:30.340288 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6655b0c2-4117-462e-8415-6de03f231dca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:30.341517 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6655b0c2-4117-462e-8415-6de03f231dca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:30.354211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6655b0c2-4117-462e-8415-6de03f231dca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:30.355151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6655b0c2-4117-462e-8415-6de03f231dca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:30.355910 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6655b0c2-4117-462e-8415-6de03f231dca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:30.357230 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6655b0c2-4117-462e-8415-6de03f231dca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:30.358169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6655b0c2-4117-462e-8415-6de03f231dca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:30.360024 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6655b0c2-4117-462e-8415-6de03f231dca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:30.398589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1afd61b6-b211-413f-980e-5bd53ced19f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:30.408970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1afd61b6-b211-413f-980e-5bd53ced19f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:30.410684 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1afd61b6-b211-413f-980e-5bd53ced19f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:30.412062 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1afd61b6-b211-413f-980e-5bd53ced19f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.228004 Aug 22 17:31:30.412709 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 173/351] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:30 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:30.441645 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6655b0c2-4117-462e-8415-6de03f231dca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:30.450124 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6655b0c2-4117-462e-8415-6de03f231dca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1245 microversion: 2.1 time: 0.117280 Aug 22 17:31:30.450869 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 179/352] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:30 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1245 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:31:31.435525 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c011400a-aaf7-47c7-85ab-4738f010d7a4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:31.436221 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c011400a-aaf7-47c7-85ab-4738f010d7a4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:31.443566 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c011400a-aaf7-47c7-85ab-4738f010d7a4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:31.444062 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c011400a-aaf7-47c7-85ab-4738f010d7a4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:31.444499 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c011400a-aaf7-47c7-85ab-4738f010d7a4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:31.445258 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c011400a-aaf7-47c7-85ab-4738f010d7a4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:31.445805 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c011400a-aaf7-47c7-85ab-4738f010d7a4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:31.446246 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c011400a-aaf7-47c7-85ab-4738f010d7a4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:31.476522 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5d9b4229-5b30-4601-b0d9-57bdb88a4954 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:31.480172 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5d9b4229-5b30-4601-b0d9-57bdb88a4954 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:31.492178 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5d9b4229-5b30-4601-b0d9-57bdb88a4954 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:31.497337 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5d9b4229-5b30-4601-b0d9-57bdb88a4954 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:31.497337 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5d9b4229-5b30-4601-b0d9-57bdb88a4954 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:31.497337 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5d9b4229-5b30-4601-b0d9-57bdb88a4954 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:31.497337 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5d9b4229-5b30-4601-b0d9-57bdb88a4954 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:31.497997 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5d9b4229-5b30-4601-b0d9-57bdb88a4954 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:31.597777 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5d9b4229-5b30-4601-b0d9-57bdb88a4954 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:31.612705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5d9b4229-5b30-4601-b0d9-57bdb88a4954 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1293 microversion: 2.1 time: 0.141514 Aug 22 17:31:31.614713 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 180/353] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:31 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1293 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:31.713481 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c011400a-aaf7-47c7-85ab-4738f010d7a4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:31.730589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c011400a-aaf7-47c7-85ab-4738f010d7a4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:31.734622 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c011400a-aaf7-47c7-85ab-4738f010d7a4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:31.736835 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c011400a-aaf7-47c7-85ab-4738f010d7a4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.305005 Aug 22 17:31:31.737854 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 174/354] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:31 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:31:32.638538 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-def03bd1-5062-4c23-8a35-8e22bbe87e22 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:32.638538 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-def03bd1-5062-4c23-8a35-8e22bbe87e22 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:32.645682 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-def03bd1-5062-4c23-8a35-8e22bbe87e22 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:32.646187 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-def03bd1-5062-4c23-8a35-8e22bbe87e22 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:32.646671 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-def03bd1-5062-4c23-8a35-8e22bbe87e22 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:32.647421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-def03bd1-5062-4c23-8a35-8e22bbe87e22 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:32.647963 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-def03bd1-5062-4c23-8a35-8e22bbe87e22 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:32.648402 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-def03bd1-5062-4c23-8a35-8e22bbe87e22 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:32.769426 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-170a57e3-7c98-4185-852b-7e2d7b0741bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:32.771788 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-170a57e3-7c98-4185-852b-7e2d7b0741bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:32.783481 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-170a57e3-7c98-4185-852b-7e2d7b0741bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:32.787236 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-170a57e3-7c98-4185-852b-7e2d7b0741bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:32.787236 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-170a57e3-7c98-4185-852b-7e2d7b0741bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:32.787236 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-170a57e3-7c98-4185-852b-7e2d7b0741bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:32.788887 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-170a57e3-7c98-4185-852b-7e2d7b0741bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:32.789647 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-170a57e3-7c98-4185-852b-7e2d7b0741bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:33.073385 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-170a57e3-7c98-4185-852b-7e2d7b0741bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:33.088486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-170a57e3-7c98-4185-852b-7e2d7b0741bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:33.092231 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-170a57e3-7c98-4185-852b-7e2d7b0741bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:33.095418 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-170a57e3-7c98-4185-852b-7e2d7b0741bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.334533 Aug 22 17:31:33.097733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 175/355] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:32 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:31:33.158436 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-def03bd1-5062-4c23-8a35-8e22bbe87e22 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:33.178631 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-def03bd1-5062-4c23-8a35-8e22bbe87e22 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1299 microversion: 2.1 time: 0.545189 Aug 22 17:31:33.178631 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 181/356] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:32 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1299 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:34.130132 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b721c890-d9e8-461a-93ef-33f984f42825 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:34.131172 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b721c890-d9e8-461a-93ef-33f984f42825 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:34.140280 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b721c890-d9e8-461a-93ef-33f984f42825 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:34.141055 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b721c890-d9e8-461a-93ef-33f984f42825 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:34.143144 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b721c890-d9e8-461a-93ef-33f984f42825 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:34.144221 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b721c890-d9e8-461a-93ef-33f984f42825 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:34.144887 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b721c890-d9e8-461a-93ef-33f984f42825 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:34.145572 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b721c890-d9e8-461a-93ef-33f984f42825 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:34.209066 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-7c57938e-ebee-4306-8ca4-5de507098146 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:34.210097 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-7c57938e-ebee-4306-8ca4-5de507098146 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:34.227597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7c57938e-ebee-4306-8ca4-5de507098146 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:34.228238 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7c57938e-ebee-4306-8ca4-5de507098146 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:34.230400 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7c57938e-ebee-4306-8ca4-5de507098146 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:34.232791 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7c57938e-ebee-4306-8ca4-5de507098146 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:34.232791 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7c57938e-ebee-4306-8ca4-5de507098146 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:34.236746 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7c57938e-ebee-4306-8ca4-5de507098146 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:34.494371 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-7c57938e-ebee-4306-8ca4-5de507098146 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:34.512290 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-7c57938e-ebee-4306-8ca4-5de507098146 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1367 microversion: 2.1 time: 0.307110 Aug 22 17:31:34.514557 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 182/357] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:34 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1367 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:31:34.521457 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b721c890-d9e8-461a-93ef-33f984f42825 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:34.540158 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b721c890-d9e8-461a-93ef-33f984f42825 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:34.543625 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b721c890-d9e8-461a-93ef-33f984f42825 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:34.545353 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b721c890-d9e8-461a-93ef-33f984f42825 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.419525 Aug 22 17:31:34.547149 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 176/358] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:34 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:34.698635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-9235b9d0-67cc-4c22-8651-f145dec57c66 req-4e4d275b-0d90-4dc3-bb44-635c2ca20af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e55a36-fde4-47f6-bc2b-9ab85db48b7c", "tag": "d88ca234-5410-4926-9330-534af21259ea"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:34.715417 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9235b9d0-67cc-4c22-8651-f145dec57c66 req-4e4d275b-0d90-4dc3-bb44-635c2ca20af4 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:34.721218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9235b9d0-67cc-4c22-8651-f145dec57c66 req-4e4d275b-0d90-4dc3-bb44-635c2ca20af4 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:34.721218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9235b9d0-67cc-4c22-8651-f145dec57c66 req-4e4d275b-0d90-4dc3-bb44-635c2ca20af4 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:34.731768 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-9235b9d0-67cc-4c22-8651-f145dec57c66 req-4e4d275b-0d90-4dc3-bb44-635c2ca20af4 service nova] Creating event network-changed:d88ca234-5410-4926-9330-534af21259ea for instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c on hv-cinder-85394 Aug 22 17:31:34.738174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-9235b9d0-67cc-4c22-8651-f145dec57c66 req-4e4d275b-0d90-4dc3-bb44-635c2ca20af4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046784 Aug 22 17:31:34.739250 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 183/359] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:31:35.551323 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e7f49681-241f-4f1d-8fad-9edc7c72ed9d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:35.552338 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e7f49681-241f-4f1d-8fad-9edc7c72ed9d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:35.562668 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e7f49681-241f-4f1d-8fad-9edc7c72ed9d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:35.563459 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e7f49681-241f-4f1d-8fad-9edc7c72ed9d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:35.563983 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e7f49681-241f-4f1d-8fad-9edc7c72ed9d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:35.564857 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e7f49681-241f-4f1d-8fad-9edc7c72ed9d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:35.565509 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e7f49681-241f-4f1d-8fad-9edc7c72ed9d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:35.566061 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e7f49681-241f-4f1d-8fad-9edc7c72ed9d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:35.586665 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-95b6993c-7589-4559-9532-5079e0bccc25 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:35.588467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-95b6993c-7589-4559-9532-5079e0bccc25 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:35.600660 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95b6993c-7589-4559-9532-5079e0bccc25 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:35.601898 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95b6993c-7589-4559-9532-5079e0bccc25 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:35.602995 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95b6993c-7589-4559-9532-5079e0bccc25 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:35.604519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95b6993c-7589-4559-9532-5079e0bccc25 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:35.605782 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95b6993c-7589-4559-9532-5079e0bccc25 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:35.606941 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95b6993c-7589-4559-9532-5079e0bccc25 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:35.760657 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e7f49681-241f-4f1d-8fad-9edc7c72ed9d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:35.777084 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e7f49681-241f-4f1d-8fad-9edc7c72ed9d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1367 microversion: 2.1 time: 0.230792 Aug 22 17:31:35.778114 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 177/360] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:35 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1367 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:35.861908 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-95b6993c-7589-4559-9532-5079e0bccc25 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:35.873625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-95b6993c-7589-4559-9532-5079e0bccc25 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:35.875975 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-95b6993c-7589-4559-9532-5079e0bccc25 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:35.877385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-95b6993c-7589-4559-9532-5079e0bccc25 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.302378 Aug 22 17:31:35.878340 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 184/361] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:35 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:36.905833 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c9ef7b45-eab0-478e-a040-d862545451a0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:36.906983 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c9ef7b45-eab0-478e-a040-d862545451a0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:36.929755 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c9ef7b45-eab0-478e-a040-d862545451a0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:36.930364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c9ef7b45-eab0-478e-a040-d862545451a0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:36.931028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c9ef7b45-eab0-478e-a040-d862545451a0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:36.931760 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c9ef7b45-eab0-478e-a040-d862545451a0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:36.932224 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c9ef7b45-eab0-478e-a040-d862545451a0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:36.932652 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c9ef7b45-eab0-478e-a040-d862545451a0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:37.118295 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-83ea923a-3703-4587-b93d-33a09022d68c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:37.119378 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-83ea923a-3703-4587-b93d-33a09022d68c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:37.132593 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-83ea923a-3703-4587-b93d-33a09022d68c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:37.133467 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-83ea923a-3703-4587-b93d-33a09022d68c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:37.134233 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-83ea923a-3703-4587-b93d-33a09022d68c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:37.135460 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-83ea923a-3703-4587-b93d-33a09022d68c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:37.136254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-83ea923a-3703-4587-b93d-33a09022d68c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:37.138316 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-83ea923a-3703-4587-b93d-33a09022d68c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:37.147317 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:37.184162 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c9ef7b45-eab0-478e-a040-d862545451a0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:37.200708 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c9ef7b45-eab0-478e-a040-d862545451a0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:37.204555 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c9ef7b45-eab0-478e-a040-d862545451a0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:37.206623 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c9ef7b45-eab0-478e-a040-d862545451a0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1743 microversion: 2.20 time: 0.307951 Aug 22 17:31:37.207272 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 185/362] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:36 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1743 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:31:37.380238 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-83ea923a-3703-4587-b93d-33a09022d68c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:37.388691 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-83ea923a-3703-4587-b93d-33a09022d68c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1367 microversion: 2.1 time: 0.578336 Aug 22 17:31:37.389373 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 178/363] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:36 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1367 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:38.241714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ca47d0f1-4afe-46f4-b545-98bdd4b483b7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:38.247505 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ca47d0f1-4afe-46f4-b545-98bdd4b483b7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:38.257064 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ca47d0f1-4afe-46f4-b545-98bdd4b483b7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:38.257566 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ca47d0f1-4afe-46f4-b545-98bdd4b483b7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:38.258006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ca47d0f1-4afe-46f4-b545-98bdd4b483b7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:38.258784 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ca47d0f1-4afe-46f4-b545-98bdd4b483b7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:38.259236 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ca47d0f1-4afe-46f4-b545-98bdd4b483b7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:38.259664 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ca47d0f1-4afe-46f4-b545-98bdd4b483b7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:38.297444 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=100 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:38.422591 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-34c1a2b1-4fcd-45e7-8fde-2f17e06172cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:38.423465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-34c1a2b1-4fcd-45e7-8fde-2f17e06172cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:38.427311 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=4 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:38.431566 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-34c1a2b1-4fcd-45e7-8fde-2f17e06172cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:38.432152 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-34c1a2b1-4fcd-45e7-8fde-2f17e06172cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:38.432649 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-34c1a2b1-4fcd-45e7-8fde-2f17e06172cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:38.433762 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-34c1a2b1-4fcd-45e7-8fde-2f17e06172cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:38.434453 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-34c1a2b1-4fcd-45e7-8fde-2f17e06172cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:38.435063 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-34c1a2b1-4fcd-45e7-8fde-2f17e06172cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:38.462754 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ca47d0f1-4afe-46f4-b545-98bdd4b483b7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:38.472967 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ca47d0f1-4afe-46f4-b545-98bdd4b483b7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:38.474989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ca47d0f1-4afe-46f4-b545-98bdd4b483b7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:38.476096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ca47d0f1-4afe-46f4-b545-98bdd4b483b7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1743 microversion: 2.20 time: 0.239370 Aug 22 17:31:38.477016 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 186/364] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:38 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1743 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:38.623113 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-34c1a2b1-4fcd-45e7-8fde-2f17e06172cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:38.640148 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-34c1a2b1-4fcd-45e7-8fde-2f17e06172cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1367 microversion: 2.1 time: 0.221527 Aug 22 17:31:38.641441 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 179/365] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:38 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:31:39.503717 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-af073ea8-460d-425c-a5ec-7bf2571925ed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:39.504436 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-af073ea8-460d-425c-a5ec-7bf2571925ed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:39.506899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:39.512677 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af073ea8-460d-425c-a5ec-7bf2571925ed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:39.513172 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af073ea8-460d-425c-a5ec-7bf2571925ed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:39.513627 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af073ea8-460d-425c-a5ec-7bf2571925ed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:39.514867 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af073ea8-460d-425c-a5ec-7bf2571925ed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:39.515328 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af073ea8-460d-425c-a5ec-7bf2571925ed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:39.515755 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af073ea8-460d-425c-a5ec-7bf2571925ed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:39.681985 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c99e2378-1959-4b92-ba1c-417808efdfd4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:39.682872 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-af073ea8-460d-425c-a5ec-7bf2571925ed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:39.687037 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c99e2378-1959-4b92-ba1c-417808efdfd4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:39.699280 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-af073ea8-460d-425c-a5ec-7bf2571925ed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:39.702878 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:39.703707 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-af073ea8-460d-425c-a5ec-7bf2571925ed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:39.704107 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=10 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:39.706215 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-af073ea8-460d-425c-a5ec-7bf2571925ed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1743 microversion: 2.20 time: 0.208277 Aug 22 17:31:39.707566 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 187/366] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:39 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1743 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:39.724018 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c99e2378-1959-4b92-ba1c-417808efdfd4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:39.725944 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c99e2378-1959-4b92-ba1c-417808efdfd4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:39.725944 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c99e2378-1959-4b92-ba1c-417808efdfd4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:39.727242 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c99e2378-1959-4b92-ba1c-417808efdfd4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:39.728098 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c99e2378-1959-4b92-ba1c-417808efdfd4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:39.728891 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c99e2378-1959-4b92-ba1c-417808efdfd4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:39.967080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c99e2378-1959-4b92-ba1c-417808efdfd4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:39.981745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c99e2378-1959-4b92-ba1c-417808efdfd4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1367 microversion: 2.1 time: 0.316722 Aug 22 17:31:39.982940 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 180/367] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:39 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1367 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:40.234178 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-63097059-177d-4daa-a86b-2dd13c801335 req-e6f3ae1a-cd05-482a-adcf-2fb95e446825 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb3959b-fd48-4a97-81d0-5b74ec4cfd32", "name": "network-vif-plugged", "status": "completed", "tag": "703038a4-7ff6-4222-b6d6-2865ce69bda5"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:40.241227 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=43 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:40.250788 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-63097059-177d-4daa-a86b-2dd13c801335 req-e6f3ae1a-cd05-482a-adcf-2fb95e446825 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:40.251502 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-63097059-177d-4daa-a86b-2dd13c801335 req-e6f3ae1a-cd05-482a-adcf-2fb95e446825 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:40.252090 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-63097059-177d-4daa-a86b-2dd13c801335 req-e6f3ae1a-cd05-482a-adcf-2fb95e446825 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:40.272668 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-63097059-177d-4daa-a86b-2dd13c801335 req-e6f3ae1a-cd05-482a-adcf-2fb95e446825 service nova] Creating event network-vif-plugged:703038a4-7ff6-4222-b6d6-2865ce69bda5 for instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 on hv-cinder-85394 Aug 22 17:31:40.279002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-63097059-177d-4daa-a86b-2dd13c801335 req-e6f3ae1a-cd05-482a-adcf-2fb95e446825 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050894 Aug 22 17:31:40.279725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 188/368] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:31:40.731840 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cb7a605e-c03c-4c37-ab29-197ab5ff8417 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:40.732823 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-cb7a605e-c03c-4c37-ab29-197ab5ff8417 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:40.742248 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb7a605e-c03c-4c37-ab29-197ab5ff8417 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:40.743060 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb7a605e-c03c-4c37-ab29-197ab5ff8417 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:40.743591 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb7a605e-c03c-4c37-ab29-197ab5ff8417 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:40.744444 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb7a605e-c03c-4c37-ab29-197ab5ff8417 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:40.744998 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb7a605e-c03c-4c37-ab29-197ab5ff8417 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:40.745537 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb7a605e-c03c-4c37-ab29-197ab5ff8417 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:40.949770 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-cb7a605e-c03c-4c37-ab29-197ab5ff8417 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:40.960131 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-cb7a605e-c03c-4c37-ab29-197ab5ff8417 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:40.962233 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-cb7a605e-c03c-4c37-ab29-197ab5ff8417 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:40.963687 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-cb7a605e-c03c-4c37-ab29-197ab5ff8417 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1743 microversion: 2.20 time: 0.236664 Aug 22 17:31:40.964315 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 181/369] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:40 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1743 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:41.016231 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9d5b21e5-30a2-4513-a8ff-24aea97f01de tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:41.017554 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9d5b21e5-30a2-4513-a8ff-24aea97f01de tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:41.026214 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d5b21e5-30a2-4513-a8ff-24aea97f01de tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:41.027111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d5b21e5-30a2-4513-a8ff-24aea97f01de tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:41.027649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d5b21e5-30a2-4513-a8ff-24aea97f01de tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:41.028638 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d5b21e5-30a2-4513-a8ff-24aea97f01de tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:41.029245 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d5b21e5-30a2-4513-a8ff-24aea97f01de tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:41.030281 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d5b21e5-30a2-4513-a8ff-24aea97f01de tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:41.215108 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9d5b21e5-30a2-4513-a8ff-24aea97f01de tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:41.225949 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9d5b21e5-30a2-4513-a8ff-24aea97f01de tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1367 microversion: 2.1 time: 0.215837 Aug 22 17:31:41.226831 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 189/370] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:41 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:31:41.971733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1204019852", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "networks": [{"uuid": "9e24ded4-95b6-4afb-8069-6070a026a0a1"}]}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:41.987817 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9c099e4f-8de4-4e04-abc0-e6f1c995a8fa tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:41.988456 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9c099e4f-8de4-4e04-abc0-e6f1c995a8fa tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:41.995375 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9c099e4f-8de4-4e04-abc0-e6f1c995a8fa tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:41.996316 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9c099e4f-8de4-4e04-abc0-e6f1c995a8fa tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:41.996316 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9c099e4f-8de4-4e04-abc0-e6f1c995a8fa tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:41.997003 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9c099e4f-8de4-4e04-abc0-e6f1c995a8fa tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:41.997599 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9c099e4f-8de4-4e04-abc0-e6f1c995a8fa tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:41.997858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9c099e4f-8de4-4e04-abc0-e6f1c995a8fa tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:42.051199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.network.neutron [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] validate_networks() for [('9e24ded4-95b6-4afb-8069-6070a026a0a1', None, None, None, None, None)] {{(pid=121853) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:31:42.209663 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9c099e4f-8de4-4e04-abc0-e6f1c995a8fa tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:42.225628 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9c099e4f-8de4-4e04-abc0-e6f1c995a8fa tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:42.228891 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9c099e4f-8de4-4e04-abc0-e6f1c995a8fa tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:42.231182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9c099e4f-8de4-4e04-abc0-e6f1c995a8fa tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1743 microversion: 2.20 time: 0.247059 Aug 22 17:31:42.235060 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 190/371] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:41 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1743 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:31:42.256851 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a9cd42d7-cf58-4125-b813-d73241886ecf tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:42.257894 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a9cd42d7-cf58-4125-b813-d73241886ecf tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:42.268973 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9cd42d7-cf58-4125-b813-d73241886ecf tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:42.270377 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9cd42d7-cf58-4125-b813-d73241886ecf tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:42.271222 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9cd42d7-cf58-4125-b813-d73241886ecf tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:42.272521 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9cd42d7-cf58-4125-b813-d73241886ecf tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:42.273361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9cd42d7-cf58-4125-b813-d73241886ecf tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:42.274140 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9cd42d7-cf58-4125-b813-d73241886ecf tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:42.534199 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a9cd42d7-cf58-4125-b813-d73241886ecf tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:42.550504 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a9cd42d7-cf58-4125-b813-d73241886ecf tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1367 microversion: 2.1 time: 0.301866 Aug 22 17:31:42.551935 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 191/372] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:42 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:42.595097 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-dd785524-ea3c-4bb7-8b0b-204d8953cc1c req-a2d9936a-9cf8-4661-adcb-96b0b02de7a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e55a36-fde4-47f6-bc2b-9ab85db48b7c", "name": "network-vif-plugged", "status": "completed", "tag": "d88ca234-5410-4926-9330-534af21259ea"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:42.611428 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-dd785524-ea3c-4bb7-8b0b-204d8953cc1c req-a2d9936a-9cf8-4661-adcb-96b0b02de7a4 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:42.611915 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-dd785524-ea3c-4bb7-8b0b-204d8953cc1c req-a2d9936a-9cf8-4661-adcb-96b0b02de7a4 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:42.612347 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-dd785524-ea3c-4bb7-8b0b-204d8953cc1c req-a2d9936a-9cf8-4661-adcb-96b0b02de7a4 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:42.636636 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-dd785524-ea3c-4bb7-8b0b-204d8953cc1c req-a2d9936a-9cf8-4661-adcb-96b0b02de7a4 service nova] Creating event network-vif-plugged:d88ca234-5410-4926-9330-534af21259ea for instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c on hv-cinder-85394 Aug 22 17:31:42.637330 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Flavor limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:31:42.637756 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Image limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:31:42.638222 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Flavor pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:31:42.638664 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Image pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:31:42.639095 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:31:42.642974 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-dd785524-ea3c-4bb7-8b0b-204d8953cc1c req-a2d9936a-9cf8-4661-adcb-96b0b02de7a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053475 Aug 22 17:31:42.644015 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 192/373] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:31:42.653530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:42.654229 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:42.655457 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:42.656784 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:42.657424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:42.657959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:42.685335 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Getting quotas for project 7508a86facdb4ff98b171aa75962dde5. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:31:42.692575 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Getting quotas for user 2351ea9262c44d74827e79231d1813c6 and project 7508a86facdb4ff98b171aa75962dde5. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:31:42.711775 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Going to run 1 instances... {{(pid=121853) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:31:42.715477 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:31:42.855311 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-9ef20703-a752-421a-8338-77db3cf853c9 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.888954 Aug 22 17:31:42.856184 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 182/374] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:31:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 891 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:31:42.873790 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-33a581f4-6d00-410f-a8d6-81d868d16b2b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:42.875092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-33a581f4-6d00-410f-a8d6-81d868d16b2b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:42.961680 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-33a581f4-6d00-410f-a8d6-81d868d16b2b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:42.971856 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-33a581f4-6d00-410f-a8d6-81d868d16b2b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1214 microversion: 2.1 time: 0.106521 Aug 22 17:31:42.972733 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 193/375] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:42 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:43.272161 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5b440638-6c61-4ddc-aee1-9193f1f5ef9c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:43.272961 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5b440638-6c61-4ddc-aee1-9193f1f5ef9c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:43.281575 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5b440638-6c61-4ddc-aee1-9193f1f5ef9c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:43.282187 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5b440638-6c61-4ddc-aee1-9193f1f5ef9c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:43.282919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5b440638-6c61-4ddc-aee1-9193f1f5ef9c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:43.284407 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5b440638-6c61-4ddc-aee1-9193f1f5ef9c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:43.285417 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5b440638-6c61-4ddc-aee1-9193f1f5ef9c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:43.286288 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5b440638-6c61-4ddc-aee1-9193f1f5ef9c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:43.467556 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5b440638-6c61-4ddc-aee1-9193f1f5ef9c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:43.479812 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5b440638-6c61-4ddc-aee1-9193f1f5ef9c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:43.482921 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5b440638-6c61-4ddc-aee1-9193f1f5ef9c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:43.484888 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5b440638-6c61-4ddc-aee1-9193f1f5ef9c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1743 microversion: 2.20 time: 0.218451 Aug 22 17:31:43.485559 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 183/376] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:43 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1743 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:31:43.578808 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2f3f1b41-8704-427b-88da-2b23445daed4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:43.579473 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-2f3f1b41-8704-427b-88da-2b23445daed4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:43.588734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2f3f1b41-8704-427b-88da-2b23445daed4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:43.589457 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2f3f1b41-8704-427b-88da-2b23445daed4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:43.590030 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2f3f1b41-8704-427b-88da-2b23445daed4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:43.590873 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2f3f1b41-8704-427b-88da-2b23445daed4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:43.591488 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2f3f1b41-8704-427b-88da-2b23445daed4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:43.591952 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2f3f1b41-8704-427b-88da-2b23445daed4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:43.778268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2f3f1b41-8704-427b-88da-2b23445daed4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:43.787462 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2f3f1b41-8704-427b-88da-2b23445daed4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1367 microversion: 2.1 time: 0.213971 Aug 22 17:31:43.788056 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 194/377] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:43 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:43.994088 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c26793d3-6603-42c9-8cfb-77996a5925ac tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:43.995025 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c26793d3-6603-42c9-8cfb-77996a5925ac tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:44.055213 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c26793d3-6603-42c9-8cfb-77996a5925ac tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:44.064300 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c26793d3-6603-42c9-8cfb-77996a5925ac tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1214 microversion: 2.1 time: 0.073983 Aug 22 17:31:44.064890 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 184/378] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:43 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:44.514702 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ca342d95-1b3e-4d6b-857d-e213258689ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:44.515946 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ca342d95-1b3e-4d6b-857d-e213258689ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:44.522312 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ca342d95-1b3e-4d6b-857d-e213258689ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:44.522828 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ca342d95-1b3e-4d6b-857d-e213258689ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:44.523261 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ca342d95-1b3e-4d6b-857d-e213258689ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:44.523942 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ca342d95-1b3e-4d6b-857d-e213258689ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:44.524392 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ca342d95-1b3e-4d6b-857d-e213258689ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:44.525053 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ca342d95-1b3e-4d6b-857d-e213258689ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:44.682794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ca342d95-1b3e-4d6b-857d-e213258689ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:44.699696 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ca342d95-1b3e-4d6b-857d-e213258689ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:44.704622 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ca342d95-1b3e-4d6b-857d-e213258689ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:44.706920 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ca342d95-1b3e-4d6b-857d-e213258689ae tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1743 microversion: 2.20 time: 0.197094 Aug 22 17:31:44.707978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 195/379] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:44 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1743 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:44.817645 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b3f97c1f-5be9-41fa-a216-14c17732a3ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:44.818846 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b3f97c1f-5be9-41fa-a216-14c17732a3ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:44.827335 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b3f97c1f-5be9-41fa-a216-14c17732a3ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:44.828014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b3f97c1f-5be9-41fa-a216-14c17732a3ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:44.828436 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b3f97c1f-5be9-41fa-a216-14c17732a3ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:44.829274 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b3f97c1f-5be9-41fa-a216-14c17732a3ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:44.829740 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b3f97c1f-5be9-41fa-a216-14c17732a3ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:44.830166 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b3f97c1f-5be9-41fa-a216-14c17732a3ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:45.022527 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b3f97c1f-5be9-41fa-a216-14c17732a3ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:45.032622 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b3f97c1f-5be9-41fa-a216-14c17732a3ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1367 microversion: 2.1 time: 0.223800 Aug 22 17:31:45.033335 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 185/380] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:44 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:45.085557 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5157bbdc-9214-415d-b3b1-69303d88e2b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:45.086889 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5157bbdc-9214-415d-b3b1-69303d88e2b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:45.094051 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5157bbdc-9214-415d-b3b1-69303d88e2b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:45.094928 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5157bbdc-9214-415d-b3b1-69303d88e2b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:45.095374 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5157bbdc-9214-415d-b3b1-69303d88e2b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:45.096126 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5157bbdc-9214-415d-b3b1-69303d88e2b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:45.096593 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5157bbdc-9214-415d-b3b1-69303d88e2b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:45.097023 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5157bbdc-9214-415d-b3b1-69303d88e2b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:45.177288 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5157bbdc-9214-415d-b3b1-69303d88e2b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:45.190133 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5157bbdc-9214-415d-b3b1-69303d88e2b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1218 microversion: 2.1 time: 0.108553 Aug 22 17:31:45.192079 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 196/381] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:45 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:46.051260 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-69cf2b69-64d1-44d4-a8fe-77928d6fc43b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:46.052891 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-69cf2b69-64d1-44d4-a8fe-77928d6fc43b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:46.057403 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-de852d5d-fe37-45fd-a90f-cdebec0dedc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:46.058220 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-de852d5d-fe37-45fd-a90f-cdebec0dedc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:46.064260 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-69cf2b69-64d1-44d4-a8fe-77928d6fc43b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:46.066585 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-69cf2b69-64d1-44d4-a8fe-77928d6fc43b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:46.066816 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de852d5d-fe37-45fd-a90f-cdebec0dedc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:46.067162 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-69cf2b69-64d1-44d4-a8fe-77928d6fc43b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:46.067670 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de852d5d-fe37-45fd-a90f-cdebec0dedc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:46.068332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-69cf2b69-64d1-44d4-a8fe-77928d6fc43b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:46.068529 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de852d5d-fe37-45fd-a90f-cdebec0dedc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:46.069120 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-69cf2b69-64d1-44d4-a8fe-77928d6fc43b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:46.069559 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de852d5d-fe37-45fd-a90f-cdebec0dedc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:46.069819 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-69cf2b69-64d1-44d4-a8fe-77928d6fc43b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:46.070272 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de852d5d-fe37-45fd-a90f-cdebec0dedc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:46.070871 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-de852d5d-fe37-45fd-a90f-cdebec0dedc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:46.324132 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-69cf2b69-64d1-44d4-a8fe-77928d6fc43b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:46.336604 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-69cf2b69-64d1-44d4-a8fe-77928d6fc43b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:46.340908 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-69cf2b69-64d1-44d4-a8fe-77928d6fc43b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:46.344132 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-69cf2b69-64d1-44d4-a8fe-77928d6fc43b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1743 microversion: 2.20 time: 0.615440 Aug 22 17:31:46.358889 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 186/382] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:45 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1743 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:46.370222 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-de852d5d-fe37-45fd-a90f-cdebec0dedc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:46.383617 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b2e634a7-180f-4cbb-a6e4-958833764032 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:46.384678 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b2e634a7-180f-4cbb-a6e4-958833764032 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:46.394857 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-de852d5d-fe37-45fd-a90f-cdebec0dedc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1557 microversion: 2.1 time: 0.340991 Aug 22 17:31:46.397024 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 197/383] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:46 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1557 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:31:46.403401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b2e634a7-180f-4cbb-a6e4-958833764032 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:46.404659 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b2e634a7-180f-4cbb-a6e4-958833764032 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:46.405580 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b2e634a7-180f-4cbb-a6e4-958833764032 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:46.407363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b2e634a7-180f-4cbb-a6e4-958833764032 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:46.408583 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b2e634a7-180f-4cbb-a6e4-958833764032 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:46.409642 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b2e634a7-180f-4cbb-a6e4-958833764032 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:46.435301 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-bec28e45-aaa7-473b-a6ce-e08402ace90f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:46.436370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-bec28e45-aaa7-473b-a6ce-e08402ace90f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:46.446000 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bec28e45-aaa7-473b-a6ce-e08402ace90f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:46.449752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bec28e45-aaa7-473b-a6ce-e08402ace90f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:46.449752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bec28e45-aaa7-473b-a6ce-e08402ace90f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:46.449752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bec28e45-aaa7-473b-a6ce-e08402ace90f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:46.449752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bec28e45-aaa7-473b-a6ce-e08402ace90f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:46.450992 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bec28e45-aaa7-473b-a6ce-e08402ace90f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:46.521691 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b2e634a7-180f-4cbb-a6e4-958833764032 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:46.536648 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b2e634a7-180f-4cbb-a6e4-958833764032 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1266 microversion: 2.1 time: 0.175273 Aug 22 17:31:46.537806 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 187/384] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:46 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:46.591336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-bec28e45-aaa7-473b-a6ce-e08402ace90f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161790 Aug 22 17:31:46.599608 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 198/385] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 22 17:31:46 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:31:47.392017 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-eac59501-624f-4be9-bbba-8926239eccc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:47.392949 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-eac59501-624f-4be9-bbba-8926239eccc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:47.400137 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-eac59501-624f-4be9-bbba-8926239eccc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:47.400647 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-eac59501-624f-4be9-bbba-8926239eccc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:47.401354 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-eac59501-624f-4be9-bbba-8926239eccc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:47.402060 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-eac59501-624f-4be9-bbba-8926239eccc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:47.402718 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-eac59501-624f-4be9-bbba-8926239eccc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:47.403142 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-eac59501-624f-4be9-bbba-8926239eccc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:47.572304 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-57c526c9-2837-42ab-afd2-17cf3ae91f1e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:47.573574 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-57c526c9-2837-42ab-afd2-17cf3ae91f1e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:47.581860 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-57c526c9-2837-42ab-afd2-17cf3ae91f1e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:47.583505 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-57c526c9-2837-42ab-afd2-17cf3ae91f1e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:47.584165 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-57c526c9-2837-42ab-afd2-17cf3ae91f1e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:47.585052 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-57c526c9-2837-42ab-afd2-17cf3ae91f1e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:47.585688 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-57c526c9-2837-42ab-afd2-17cf3ae91f1e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:47.586273 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-57c526c9-2837-42ab-afd2-17cf3ae91f1e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:47.823859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-eac59501-624f-4be9-bbba-8926239eccc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:47.847172 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-eac59501-624f-4be9-bbba-8926239eccc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:47.851746 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-eac59501-624f-4be9-bbba-8926239eccc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:47.853929 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-eac59501-624f-4be9-bbba-8926239eccc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1743 microversion: 2.20 time: 0.470872 Aug 22 17:31:47.858443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 188/386] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:47 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1743 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:31:47.864089 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-57c526c9-2837-42ab-afd2-17cf3ae91f1e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:47.879952 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-57c526c9-2837-42ab-afd2-17cf3ae91f1e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1272 microversion: 2.1 time: 0.311693 Aug 22 17:31:47.891223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 199/387] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:47 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1272 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:48.451194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-be7ae0e7-fb61-46fc-8077-4dfcb0f75e95 req-d9971949-af2f-4e02-8188-594af0cbfe1e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3e55a36-fde4-47f6-bc2b-9ab85db48b7c", "tag": "d88ca234-5410-4926-9330-534af21259ea"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:48.472994 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-be7ae0e7-fb61-46fc-8077-4dfcb0f75e95 req-d9971949-af2f-4e02-8188-594af0cbfe1e service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:48.473839 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-be7ae0e7-fb61-46fc-8077-4dfcb0f75e95 req-d9971949-af2f-4e02-8188-594af0cbfe1e service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:48.474816 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-be7ae0e7-fb61-46fc-8077-4dfcb0f75e95 req-d9971949-af2f-4e02-8188-594af0cbfe1e service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:48.517066 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-be7ae0e7-fb61-46fc-8077-4dfcb0f75e95 req-d9971949-af2f-4e02-8188-594af0cbfe1e service nova] Creating event network-changed:d88ca234-5410-4926-9330-534af21259ea for instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c on hv-cinder-85394 Aug 22 17:31:48.527798 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-be7ae0e7-fb61-46fc-8077-4dfcb0f75e95 req-d9971949-af2f-4e02-8188-594af0cbfe1e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088315 Aug 22 17:31:48.530993 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 189/388] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:31:48.911833 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-7d195bfc-b2c2-41a3-922e-4a2a21122749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:48.914550 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-7d195bfc-b2c2-41a3-922e-4a2a21122749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:48.928639 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-44bba236-4d04-430f-9a73-22051423a946 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:49.032962 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7d195bfc-b2c2-41a3-922e-4a2a21122749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:49.032962 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7d195bfc-b2c2-41a3-922e-4a2a21122749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:49.032962 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7d195bfc-b2c2-41a3-922e-4a2a21122749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:49.036584 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-44bba236-4d04-430f-9a73-22051423a946 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:49.039230 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7d195bfc-b2c2-41a3-922e-4a2a21122749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:49.039230 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7d195bfc-b2c2-41a3-922e-4a2a21122749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:49.039230 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7d195bfc-b2c2-41a3-922e-4a2a21122749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:49.040398 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-44bba236-4d04-430f-9a73-22051423a946 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:49.040398 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-44bba236-4d04-430f-9a73-22051423a946 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:49.040398 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-44bba236-4d04-430f-9a73-22051423a946 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:49.040398 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-44bba236-4d04-430f-9a73-22051423a946 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:49.041628 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-44bba236-4d04-430f-9a73-22051423a946 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:49.041628 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-44bba236-4d04-430f-9a73-22051423a946 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:49.653496 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-7d195bfc-b2c2-41a3-922e-4a2a21122749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:49.673928 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-7d195bfc-b2c2-41a3-922e-4a2a21122749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:49.676015 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-7d195bfc-b2c2-41a3-922e-4a2a21122749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:49.677604 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-7d195bfc-b2c2-41a3-922e-4a2a21122749 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.778000 Aug 22 17:31:49.678383 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 200/389] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:48 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:49.880788 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-44bba236-4d04-430f-9a73-22051423a946 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:49.896695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-44bba236-4d04-430f-9a73-22051423a946 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1314 microversion: 2.1 time: 0.981383 Aug 22 17:31:49.914934 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 190/390] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:48 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1314 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:50.284304 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-64b6aeee-c56d-40d9-b20c-074f35a149c1 req-f851bd09-cd82-4fb4-9c2e-0931f00d0bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2ad1a61-a52e-40b1-b0fa-2055f52a7b91", "tag": "0b3dd5dc-f222-454e-b4a7-c00075b3585f"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:31:50.300330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-64b6aeee-c56d-40d9-b20c-074f35a149c1 req-f851bd09-cd82-4fb4-9c2e-0931f00d0bf8 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:50.303463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-64b6aeee-c56d-40d9-b20c-074f35a149c1 req-f851bd09-cd82-4fb4-9c2e-0931f00d0bf8 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:50.308120 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-64b6aeee-c56d-40d9-b20c-074f35a149c1 req-f851bd09-cd82-4fb4-9c2e-0931f00d0bf8 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:50.337480 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-64b6aeee-c56d-40d9-b20c-074f35a149c1 req-f851bd09-cd82-4fb4-9c2e-0931f00d0bf8 service nova] Creating event network-changed:0b3dd5dc-f222-454e-b4a7-c00075b3585f for instance d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 on hv-cinder-85394 Aug 22 17:31:50.348101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-64b6aeee-c56d-40d9-b20c-074f35a149c1 req-f851bd09-cd82-4fb4-9c2e-0931f00d0bf8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066913 Aug 22 17:31:50.349108 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 201/391] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:31:50.725440 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2400c4e1-6343-40d8-b41b-b73bc441e634 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:50.726544 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2400c4e1-6343-40d8-b41b-b73bc441e634 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:50.743839 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2400c4e1-6343-40d8-b41b-b73bc441e634 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:50.744423 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2400c4e1-6343-40d8-b41b-b73bc441e634 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:50.744947 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2400c4e1-6343-40d8-b41b-b73bc441e634 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:50.745874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2400c4e1-6343-40d8-b41b-b73bc441e634 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:50.746368 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2400c4e1-6343-40d8-b41b-b73bc441e634 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:50.747011 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2400c4e1-6343-40d8-b41b-b73bc441e634 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:50.928568 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6184e4da-f566-48cd-bf4a-4969e3fc112e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:50.929855 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6184e4da-f566-48cd-bf4a-4969e3fc112e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:50.954105 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6184e4da-f566-48cd-bf4a-4969e3fc112e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:50.955025 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6184e4da-f566-48cd-bf4a-4969e3fc112e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:50.960345 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6184e4da-f566-48cd-bf4a-4969e3fc112e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:50.961796 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6184e4da-f566-48cd-bf4a-4969e3fc112e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:50.962703 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6184e4da-f566-48cd-bf4a-4969e3fc112e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:50.963480 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6184e4da-f566-48cd-bf4a-4969e3fc112e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:51.277390 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2400c4e1-6343-40d8-b41b-b73bc441e634 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:51.324858 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2400c4e1-6343-40d8-b41b-b73bc441e634 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:51.342972 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2400c4e1-6343-40d8-b41b-b73bc441e634 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:51.351612 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2400c4e1-6343-40d8-b41b-b73bc441e634 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.624084 Aug 22 17:31:51.361635 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 191/392] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:50 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:51.775141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6184e4da-f566-48cd-bf4a-4969e3fc112e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:51.791283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6184e4da-f566-48cd-bf4a-4969e3fc112e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1314 microversion: 2.1 time: 0.871345 Aug 22 17:31:51.806206 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 202/393] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:50 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1314 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:31:52.381039 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ebddc7a8-9715-41f1-8f23-f0c47c9a8271 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:52.382576 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ebddc7a8-9715-41f1-8f23-f0c47c9a8271 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:52.393346 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ebddc7a8-9715-41f1-8f23-f0c47c9a8271 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:52.394152 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ebddc7a8-9715-41f1-8f23-f0c47c9a8271 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:52.394829 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ebddc7a8-9715-41f1-8f23-f0c47c9a8271 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:52.395807 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ebddc7a8-9715-41f1-8f23-f0c47c9a8271 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:52.396462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ebddc7a8-9715-41f1-8f23-f0c47c9a8271 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:52.396892 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ebddc7a8-9715-41f1-8f23-f0c47c9a8271 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:52.668260 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:52.814987 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2026c0e3-9aec-4920-adfa-582d687fcd2a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:52.815519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-2026c0e3-9aec-4920-adfa-582d687fcd2a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:52.827251 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2026c0e3-9aec-4920-adfa-582d687fcd2a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:52.827940 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2026c0e3-9aec-4920-adfa-582d687fcd2a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:52.831252 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2026c0e3-9aec-4920-adfa-582d687fcd2a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:52.832244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2026c0e3-9aec-4920-adfa-582d687fcd2a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:52.834119 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2026c0e3-9aec-4920-adfa-582d687fcd2a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:52.838979 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2026c0e3-9aec-4920-adfa-582d687fcd2a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:52.898902 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ebddc7a8-9715-41f1-8f23-f0c47c9a8271 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:52.913664 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ebddc7a8-9715-41f1-8f23-f0c47c9a8271 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:52.916030 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ebddc7a8-9715-41f1-8f23-f0c47c9a8271 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:52.927065 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ebddc7a8-9715-41f1-8f23-f0c47c9a8271 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.551089 Aug 22 17:31:52.928008 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 192/394] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:52 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:52.969783 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:53.198263 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2026c0e3-9aec-4920-adfa-582d687fcd2a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:53.213912 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2026c0e3-9aec-4920-adfa-582d687fcd2a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1314 microversion: 2.1 time: 0.403692 Aug 22 17:31:53.215779 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 203/395] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:52 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1314 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:53.366544 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:31:53.366864 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Mon Aug 22 17:31:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:31:53.956528 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e25cc8ef-5772-4b9d-afa4-7c9d926a04de tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:53.957445 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e25cc8ef-5772-4b9d-afa4-7c9d926a04de tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:53.977779 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e25cc8ef-5772-4b9d-afa4-7c9d926a04de tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:53.978273 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e25cc8ef-5772-4b9d-afa4-7c9d926a04de tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:53.978954 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e25cc8ef-5772-4b9d-afa4-7c9d926a04de tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:53.979885 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e25cc8ef-5772-4b9d-afa4-7c9d926a04de tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:53.980529 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e25cc8ef-5772-4b9d-afa4-7c9d926a04de tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:53.981159 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e25cc8ef-5772-4b9d-afa4-7c9d926a04de tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:54.062362 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=8 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:54.251931 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0acb9891-a308-4974-8e43-1b17714e0254 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:54.255366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0acb9891-a308-4974-8e43-1b17714e0254 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:54.271720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0acb9891-a308-4974-8e43-1b17714e0254 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:54.273325 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0acb9891-a308-4974-8e43-1b17714e0254 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:54.275517 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0acb9891-a308-4974-8e43-1b17714e0254 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:54.277552 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0acb9891-a308-4974-8e43-1b17714e0254 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:54.279132 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0acb9891-a308-4974-8e43-1b17714e0254 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:54.293391 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0acb9891-a308-4974-8e43-1b17714e0254 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:54.579512 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0acb9891-a308-4974-8e43-1b17714e0254 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:54.581436 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e25cc8ef-5772-4b9d-afa4-7c9d926a04de tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:54.596661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0acb9891-a308-4974-8e43-1b17714e0254 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1314 microversion: 2.1 time: 0.360904 Aug 22 17:31:54.598130 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e25cc8ef-5772-4b9d-afa4-7c9d926a04de tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:54.604115 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e25cc8ef-5772-4b9d-afa4-7c9d926a04de tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:54.605090 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 204/396] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:54 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:54.611451 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e25cc8ef-5772-4b9d-afa4-7c9d926a04de tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.662009 Aug 22 17:31:54.613419 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 193/397] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:53 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:55.635961 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-71d8bc5d-8b3f-47c7-a15e-ec3924f29979 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:55.637071 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-71d8bc5d-8b3f-47c7-a15e-ec3924f29979 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:55.646743 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-71d8bc5d-8b3f-47c7-a15e-ec3924f29979 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:55.647391 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-71d8bc5d-8b3f-47c7-a15e-ec3924f29979 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:55.647958 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-71d8bc5d-8b3f-47c7-a15e-ec3924f29979 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:55.648843 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-71d8bc5d-8b3f-47c7-a15e-ec3924f29979 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:55.649405 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-71d8bc5d-8b3f-47c7-a15e-ec3924f29979 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:55.650619 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-71d8bc5d-8b3f-47c7-a15e-ec3924f29979 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:55.657905 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0174b5a2-65e2-424b-b0d4-7071e605c66f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:55.659940 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0174b5a2-65e2-424b-b0d4-7071e605c66f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:55.669902 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0174b5a2-65e2-424b-b0d4-7071e605c66f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:55.671954 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0174b5a2-65e2-424b-b0d4-7071e605c66f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:55.673016 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0174b5a2-65e2-424b-b0d4-7071e605c66f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:55.674251 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0174b5a2-65e2-424b-b0d4-7071e605c66f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:55.675154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0174b5a2-65e2-424b-b0d4-7071e605c66f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:55.675819 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0174b5a2-65e2-424b-b0d4-7071e605c66f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:55.929830 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-71d8bc5d-8b3f-47c7-a15e-ec3924f29979 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:55.949306 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-71d8bc5d-8b3f-47c7-a15e-ec3924f29979 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:55.953502 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-71d8bc5d-8b3f-47c7-a15e-ec3924f29979 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:55.955949 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-71d8bc5d-8b3f-47c7-a15e-ec3924f29979 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.323535 Aug 22 17:31:55.957185 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 205/398] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:55 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:56.073415 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0174b5a2-65e2-424b-b0d4-7071e605c66f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:56.109892 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0174b5a2-65e2-424b-b0d4-7071e605c66f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1314 microversion: 2.1 time: 0.457356 Aug 22 17:31:56.113220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 194/399] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:55 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:57.001717 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-50284dcc-0067-4e18-ad01-a676378cdaee tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:57.002712 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-50284dcc-0067-4e18-ad01-a676378cdaee tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:57.027562 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-50284dcc-0067-4e18-ad01-a676378cdaee tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:57.039801 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-50284dcc-0067-4e18-ad01-a676378cdaee tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:57.040426 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-50284dcc-0067-4e18-ad01-a676378cdaee tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:57.041903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-50284dcc-0067-4e18-ad01-a676378cdaee tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:57.042118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-50284dcc-0067-4e18-ad01-a676378cdaee tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:57.042406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-50284dcc-0067-4e18-ad01-a676378cdaee tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:57.085418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=100 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:31:57.147321 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1c563257-7cd9-4c09-8bee-285b95b1a25a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:57.149146 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1c563257-7cd9-4c09-8bee-285b95b1a25a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:57.182023 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1c563257-7cd9-4c09-8bee-285b95b1a25a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:57.182023 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1c563257-7cd9-4c09-8bee-285b95b1a25a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:57.182023 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1c563257-7cd9-4c09-8bee-285b95b1a25a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:57.182023 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1c563257-7cd9-4c09-8bee-285b95b1a25a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:57.182732 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1c563257-7cd9-4c09-8bee-285b95b1a25a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:57.189549 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1c563257-7cd9-4c09-8bee-285b95b1a25a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:57.501996 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1c563257-7cd9-4c09-8bee-285b95b1a25a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:57.517303 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1c563257-7cd9-4c09-8bee-285b95b1a25a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1314 microversion: 2.1 time: 0.375895 Aug 22 17:31:57.518052 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 195/400] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:57 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:31:57.567866 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-50284dcc-0067-4e18-ad01-a676378cdaee tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:57.581190 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-50284dcc-0067-4e18-ad01-a676378cdaee tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:57.582775 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-50284dcc-0067-4e18-ad01-a676378cdaee tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:57.584038 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-50284dcc-0067-4e18-ad01-a676378cdaee tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.589858 Aug 22 17:31:57.584803 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 206/401] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:56 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:31:58.540901 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d8ca4eaa-b2f1-4025-901a-5a28aa71bcba tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:58.541763 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d8ca4eaa-b2f1-4025-901a-5a28aa71bcba tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:58.549544 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8ca4eaa-b2f1-4025-901a-5a28aa71bcba tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:58.550618 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8ca4eaa-b2f1-4025-901a-5a28aa71bcba tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:58.552917 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8ca4eaa-b2f1-4025-901a-5a28aa71bcba tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:58.554000 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8ca4eaa-b2f1-4025-901a-5a28aa71bcba tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:58.554606 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8ca4eaa-b2f1-4025-901a-5a28aa71bcba tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:58.555260 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8ca4eaa-b2f1-4025-901a-5a28aa71bcba tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:58.620847 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-aff2a574-ccdc-4cbc-97ef-aff65996c8d2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:31:58.622104 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-aff2a574-ccdc-4cbc-97ef-aff65996c8d2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:31:58.643145 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aff2a574-ccdc-4cbc-97ef-aff65996c8d2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:58.643994 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aff2a574-ccdc-4cbc-97ef-aff65996c8d2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:58.644613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aff2a574-ccdc-4cbc-97ef-aff65996c8d2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:58.645519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aff2a574-ccdc-4cbc-97ef-aff65996c8d2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:31:58.646276 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aff2a574-ccdc-4cbc-97ef-aff65996c8d2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:31:58.646891 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aff2a574-ccdc-4cbc-97ef-aff65996c8d2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:31:58.939068 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d8ca4eaa-b2f1-4025-901a-5a28aa71bcba tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:58.972006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-aff2a574-ccdc-4cbc-97ef-aff65996c8d2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:58.977226 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d8ca4eaa-b2f1-4025-901a-5a28aa71bcba tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1314 microversion: 2.1 time: 0.439999 Aug 22 17:31:58.981668 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 196/402] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:58 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:31:58.994565 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-aff2a574-ccdc-4cbc-97ef-aff65996c8d2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:58.996750 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-aff2a574-ccdc-4cbc-97ef-aff65996c8d2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:31:58.999277 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-aff2a574-ccdc-4cbc-97ef-aff65996c8d2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.381868 Aug 22 17:31:59.000759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 207/403] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:31:58 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:00.008731 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e02a5c60-d54b-43d7-8de5-c69c61924052 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:00.010905 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e02a5c60-d54b-43d7-8de5-c69c61924052 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:00.035109 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e02a5c60-d54b-43d7-8de5-c69c61924052 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:00.040327 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e02a5c60-d54b-43d7-8de5-c69c61924052 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:00.043361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e02a5c60-d54b-43d7-8de5-c69c61924052 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:00.048909 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e02a5c60-d54b-43d7-8de5-c69c61924052 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:00.053000 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e02a5c60-d54b-43d7-8de5-c69c61924052 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:00.053774 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e02a5c60-d54b-43d7-8de5-c69c61924052 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:00.062679 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b70d28a5-dc62-44c0-8ae8-88166fd994b5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:00.067784 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b70d28a5-dc62-44c0-8ae8-88166fd994b5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:00.084363 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b70d28a5-dc62-44c0-8ae8-88166fd994b5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:00.087272 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b70d28a5-dc62-44c0-8ae8-88166fd994b5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:00.088521 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b70d28a5-dc62-44c0-8ae8-88166fd994b5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:00.090300 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b70d28a5-dc62-44c0-8ae8-88166fd994b5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:00.091599 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b70d28a5-dc62-44c0-8ae8-88166fd994b5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:00.093245 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b70d28a5-dc62-44c0-8ae8-88166fd994b5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:00.144539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=100 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:00.481044 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b70d28a5-dc62-44c0-8ae8-88166fd994b5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:00.515844 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b70d28a5-dc62-44c0-8ae8-88166fd994b5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:00.522253 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b70d28a5-dc62-44c0-8ae8-88166fd994b5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:00.530279 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e02a5c60-d54b-43d7-8de5-c69c61924052 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:00.531374 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b70d28a5-dc62-44c0-8ae8-88166fd994b5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.486658 Aug 22 17:32:00.538749 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 208/404] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:00 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:00.550836 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e02a5c60-d54b-43d7-8de5-c69c61924052 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1314 microversion: 2.1 time: 0.553610 Aug 22 17:32:00.564800 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 197/405] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:31:59 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1314 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:00.816583 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-14e47a0f-71a8-46e0-8fff-ae8360096862 req-a54d7de2-608b-478e-acac-1e30908f9733 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ad1a61-a52e-40b1-b0fa-2055f52a7b91", "name": "network-vif-plugged", "status": "completed", "tag": "0b3dd5dc-f222-454e-b4a7-c00075b3585f"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:00.841516 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-14e47a0f-71a8-46e0-8fff-ae8360096862 req-a54d7de2-608b-478e-acac-1e30908f9733 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:00.842918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-14e47a0f-71a8-46e0-8fff-ae8360096862 req-a54d7de2-608b-478e-acac-1e30908f9733 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:00.843675 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-14e47a0f-71a8-46e0-8fff-ae8360096862 req-a54d7de2-608b-478e-acac-1e30908f9733 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:00.862836 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-14e47a0f-71a8-46e0-8fff-ae8360096862 req-a54d7de2-608b-478e-acac-1e30908f9733 service nova] Creating event network-vif-plugged:0b3dd5dc-f222-454e-b4a7-c00075b3585f for instance d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 on hv-cinder-85394 Aug 22 17:32:00.869456 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-14e47a0f-71a8-46e0-8fff-ae8360096862 req-a54d7de2-608b-478e-acac-1e30908f9733 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062138 Aug 22 17:32:00.870823 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 209/406] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:32:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:32:01.581011 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f8302d29-74d4-40fe-b05d-79a561e24453 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:01.583986 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f8302d29-74d4-40fe-b05d-79a561e24453 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:01.600052 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a8299480-003a-4fc7-8600-71762da316ce tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:01.601149 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a8299480-003a-4fc7-8600-71762da316ce tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:01.601582 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f8302d29-74d4-40fe-b05d-79a561e24453 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:01.602467 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f8302d29-74d4-40fe-b05d-79a561e24453 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:01.603310 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f8302d29-74d4-40fe-b05d-79a561e24453 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:01.604597 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f8302d29-74d4-40fe-b05d-79a561e24453 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:01.605526 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f8302d29-74d4-40fe-b05d-79a561e24453 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:01.606137 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f8302d29-74d4-40fe-b05d-79a561e24453 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:01.615707 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8299480-003a-4fc7-8600-71762da316ce tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:01.616593 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8299480-003a-4fc7-8600-71762da316ce tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:01.617410 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8299480-003a-4fc7-8600-71762da316ce tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:01.625718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8299480-003a-4fc7-8600-71762da316ce tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:01.625718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8299480-003a-4fc7-8600-71762da316ce tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:01.625718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8299480-003a-4fc7-8600-71762da316ce tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:01.881352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f8302d29-74d4-40fe-b05d-79a561e24453 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:01.895097 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f8302d29-74d4-40fe-b05d-79a561e24453 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:01.898377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f8302d29-74d4-40fe-b05d-79a561e24453 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:01.905221 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f8302d29-74d4-40fe-b05d-79a561e24453 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.330561 Aug 22 17:32:01.924507 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 198/407] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:01 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:01.956153 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a8299480-003a-4fc7-8600-71762da316ce tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:01.987262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a8299480-003a-4fc7-8600-71762da316ce tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1314 microversion: 2.1 time: 0.393802 Aug 22 17:32:01.988377 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 210/408] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:01 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:02.947343 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-58ee9d86-4aa4-472b-9053-a7f056114c5d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:02.949874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-58ee9d86-4aa4-472b-9053-a7f056114c5d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:02.979457 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-58ee9d86-4aa4-472b-9053-a7f056114c5d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:02.983693 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-58ee9d86-4aa4-472b-9053-a7f056114c5d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:02.987331 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-58ee9d86-4aa4-472b-9053-a7f056114c5d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:02.989195 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-58ee9d86-4aa4-472b-9053-a7f056114c5d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:02.990400 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-58ee9d86-4aa4-472b-9053-a7f056114c5d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:02.991591 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-58ee9d86-4aa4-472b-9053-a7f056114c5d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:03.042368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3a5f0109-2b52-4443-940e-ea188caacfa2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:03.047879 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3a5f0109-2b52-4443-940e-ea188caacfa2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:03.092566 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a5f0109-2b52-4443-940e-ea188caacfa2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:03.094011 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a5f0109-2b52-4443-940e-ea188caacfa2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:03.095036 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a5f0109-2b52-4443-940e-ea188caacfa2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:03.096577 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a5f0109-2b52-4443-940e-ea188caacfa2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:03.097635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a5f0109-2b52-4443-940e-ea188caacfa2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:03.098681 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a5f0109-2b52-4443-940e-ea188caacfa2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:03.311840 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-58ee9d86-4aa4-472b-9053-a7f056114c5d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:03.334537 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-58ee9d86-4aa4-472b-9053-a7f056114c5d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:03.349150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-58ee9d86-4aa4-472b-9053-a7f056114c5d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:03.353024 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-58ee9d86-4aa4-472b-9053-a7f056114c5d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.421495 Aug 22 17:32:03.354967 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 199/409] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:02 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:03.512457 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3a5f0109-2b52-4443-940e-ea188caacfa2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:03.534463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3a5f0109-2b52-4443-940e-ea188caacfa2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1314 microversion: 2.1 time: 0.512153 Aug 22 17:32:03.536351 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 211/410] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:03 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1314 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:04.410024 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f88b8e60-4388-471b-9e5b-96c44df8a5d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:04.413118 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f88b8e60-4388-471b-9e5b-96c44df8a5d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:04.458794 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f88b8e60-4388-471b-9e5b-96c44df8a5d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:04.462133 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f88b8e60-4388-471b-9e5b-96c44df8a5d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:04.464973 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f88b8e60-4388-471b-9e5b-96c44df8a5d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:04.466701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f88b8e60-4388-471b-9e5b-96c44df8a5d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:04.469055 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f88b8e60-4388-471b-9e5b-96c44df8a5d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:04.470280 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f88b8e60-4388-471b-9e5b-96c44df8a5d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:04.559091 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-1230874c-b4ca-4a68-b23e-a7585c7d215e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:04.562332 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-1230874c-b4ca-4a68-b23e-a7585c7d215e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:04.574178 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1230874c-b4ca-4a68-b23e-a7585c7d215e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:04.574743 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1230874c-b4ca-4a68-b23e-a7585c7d215e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:04.575208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1230874c-b4ca-4a68-b23e-a7585c7d215e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:04.580949 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1230874c-b4ca-4a68-b23e-a7585c7d215e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:04.582035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1230874c-b4ca-4a68-b23e-a7585c7d215e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:04.582714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1230874c-b4ca-4a68-b23e-a7585c7d215e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:04.866267 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-1230874c-b4ca-4a68-b23e-a7585c7d215e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:04.904840 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-1230874c-b4ca-4a68-b23e-a7585c7d215e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1497 microversion: 2.1 time: 0.351379 Aug 22 17:32:04.920144 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 212/411] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:04 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1497 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:05.096674 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f88b8e60-4388-471b-9e5b-96c44df8a5d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:05.109176 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f88b8e60-4388-471b-9e5b-96c44df8a5d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:05.111341 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f88b8e60-4388-471b-9e5b-96c44df8a5d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:05.113096 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f88b8e60-4388-471b-9e5b-96c44df8a5d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.719015 Aug 22 17:32:05.141297 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 200/412] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:04 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:06.142798 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-90fc9a02-f3ab-47d9-b09a-180e22fb26e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:06.148923 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-90fc9a02-f3ab-47d9-b09a-180e22fb26e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:06.185135 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-90fc9a02-f3ab-47d9-b09a-180e22fb26e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:06.186748 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-90fc9a02-f3ab-47d9-b09a-180e22fb26e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:06.187772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-90fc9a02-f3ab-47d9-b09a-180e22fb26e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:06.189448 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-90fc9a02-f3ab-47d9-b09a-180e22fb26e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:06.190577 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-90fc9a02-f3ab-47d9-b09a-180e22fb26e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:06.192556 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-90fc9a02-f3ab-47d9-b09a-180e22fb26e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:06.236824 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0fe05a10-b947-4b51-85ba-cc0bdc6f890f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:06.237960 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0fe05a10-b947-4b51-85ba-cc0bdc6f890f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:06.278331 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0fe05a10-b947-4b51-85ba-cc0bdc6f890f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:06.278331 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0fe05a10-b947-4b51-85ba-cc0bdc6f890f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:06.278331 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0fe05a10-b947-4b51-85ba-cc0bdc6f890f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:06.278331 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0fe05a10-b947-4b51-85ba-cc0bdc6f890f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:06.283555 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0fe05a10-b947-4b51-85ba-cc0bdc6f890f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:06.284384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0fe05a10-b947-4b51-85ba-cc0bdc6f890f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:06.415322 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0fe05a10-b947-4b51-85ba-cc0bdc6f890f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Going to try to terminate instance {{(pid=121853) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:32:06.595382 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-90fc9a02-f3ab-47d9-b09a-180e22fb26e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:06.609961 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-90fc9a02-f3ab-47d9-b09a-180e22fb26e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:06.612186 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-90fc9a02-f3ab-47d9-b09a-180e22fb26e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:06.617606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-90fc9a02-f3ab-47d9-b09a-180e22fb26e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.480367 Aug 22 17:32:06.617606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 213/413] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:06 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:07.079934 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0fe05a10-b947-4b51-85ba-cc0bdc6f890f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 204 len: 0 microversion: 2.1 time: 0.880401 Aug 22 17:32:07.081103 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 201/414] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:32:06 2022] DELETE /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 0 bytes in 883 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:32:07.089691 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9f53a478-435b-40fd-8912-e89ca5fc9068 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:07.090510 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9f53a478-435b-40fd-8912-e89ca5fc9068 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:07.111727 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9f53a478-435b-40fd-8912-e89ca5fc9068 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:07.133739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9f53a478-435b-40fd-8912-e89ca5fc9068 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:07.135123 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9f53a478-435b-40fd-8912-e89ca5fc9068 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:07.136048 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9f53a478-435b-40fd-8912-e89ca5fc9068 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:07.137142 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9f53a478-435b-40fd-8912-e89ca5fc9068 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:07.141324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9f53a478-435b-40fd-8912-e89ca5fc9068 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:07.465971 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9f53a478-435b-40fd-8912-e89ca5fc9068 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:07.492332 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9f53a478-435b-40fd-8912-e89ca5fc9068 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1503 microversion: 2.1 time: 0.401228 Aug 22 17:32:07.493066 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 214/415] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:07 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1503 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:07.691084 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a7d6216b-df7c-44c7-aa5d-1e2aa67ec913 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:07.693646 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a7d6216b-df7c-44c7-aa5d-1e2aa67ec913 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:07.708990 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7d6216b-df7c-44c7-aa5d-1e2aa67ec913 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:07.713356 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7d6216b-df7c-44c7-aa5d-1e2aa67ec913 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:07.714200 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7d6216b-df7c-44c7-aa5d-1e2aa67ec913 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:07.715220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7d6216b-df7c-44c7-aa5d-1e2aa67ec913 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:07.718366 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7d6216b-df7c-44c7-aa5d-1e2aa67ec913 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:07.718972 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7d6216b-df7c-44c7-aa5d-1e2aa67ec913 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:08.358672 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a7d6216b-df7c-44c7-aa5d-1e2aa67ec913 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:08.368587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a7d6216b-df7c-44c7-aa5d-1e2aa67ec913 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:08.371316 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a7d6216b-df7c-44c7-aa5d-1e2aa67ec913 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:08.372563 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a7d6216b-df7c-44c7-aa5d-1e2aa67ec913 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.707066 Aug 22 17:32:08.374697 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 202/416] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:07 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:08.521343 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-bbd50148-3ef5-48ef-97e9-a435fa1c1e3f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:08.523286 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-bbd50148-3ef5-48ef-97e9-a435fa1c1e3f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:08.539668 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bbd50148-3ef5-48ef-97e9-a435fa1c1e3f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:08.541066 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bbd50148-3ef5-48ef-97e9-a435fa1c1e3f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:08.542575 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bbd50148-3ef5-48ef-97e9-a435fa1c1e3f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:08.544256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bbd50148-3ef5-48ef-97e9-a435fa1c1e3f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:08.546019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bbd50148-3ef5-48ef-97e9-a435fa1c1e3f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:08.547258 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bbd50148-3ef5-48ef-97e9-a435fa1c1e3f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:08.880280 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-bbd50148-3ef5-48ef-97e9-a435fa1c1e3f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:08.893179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-bbd50148-3ef5-48ef-97e9-a435fa1c1e3f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1503 microversion: 2.1 time: 0.379900 Aug 22 17:32:08.900318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 215/417] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:08 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1503 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:09.414587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-dfe9010c-f410-4ce7-812e-5e04dd3b0db9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:09.415627 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-dfe9010c-f410-4ce7-812e-5e04dd3b0db9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:09.440722 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dfe9010c-f410-4ce7-812e-5e04dd3b0db9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:09.441901 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dfe9010c-f410-4ce7-812e-5e04dd3b0db9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:09.442974 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dfe9010c-f410-4ce7-812e-5e04dd3b0db9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:09.444552 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dfe9010c-f410-4ce7-812e-5e04dd3b0db9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:09.445665 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dfe9010c-f410-4ce7-812e-5e04dd3b0db9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:09.446627 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dfe9010c-f410-4ce7-812e-5e04dd3b0db9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:09.936971 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-065e6b1c-d414-4060-87bb-2c4617c54537 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:09.938281 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-065e6b1c-d414-4060-87bb-2c4617c54537 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:09.954740 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-dfe9010c-f410-4ce7-812e-5e04dd3b0db9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:09.959481 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-065e6b1c-d414-4060-87bb-2c4617c54537 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:09.960044 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-065e6b1c-d414-4060-87bb-2c4617c54537 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:09.960507 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-065e6b1c-d414-4060-87bb-2c4617c54537 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:09.961276 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-065e6b1c-d414-4060-87bb-2c4617c54537 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:09.961725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-065e6b1c-d414-4060-87bb-2c4617c54537 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:09.970072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-065e6b1c-d414-4060-87bb-2c4617c54537 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:10.000028 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-dfe9010c-f410-4ce7-812e-5e04dd3b0db9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:10.008192 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-dfe9010c-f410-4ce7-812e-5e04dd3b0db9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:10.012762 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-dfe9010c-f410-4ce7-812e-5e04dd3b0db9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.605002 Aug 22 17:32:10.019869 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 203/418] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:09 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:10.113182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-065e6b1c-d414-4060-87bb-2c4617c54537 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:10.126402 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-065e6b1c-d414-4060-87bb-2c4617c54537 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1461 microversion: 2.1 time: 0.193657 Aug 22 17:32:10.127599 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 216/419] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:09 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1461 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:10.181699 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-4a2310bc-f58a-4830-be54-06c2b72eaa15 req-6cb7de92-df5e-4eaa-b762-21412f3b4b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2ad1a61-a52e-40b1-b0fa-2055f52a7b91", "name": "network-vif-deleted", "tag": "0b3dd5dc-f222-454e-b4a7-c00075b3585f"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:10.230340 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:10.243555 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-4a2310bc-f58a-4830-be54-06c2b72eaa15 req-6cb7de92-df5e-4eaa-b762-21412f3b4b86 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:10.245184 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-4a2310bc-f58a-4830-be54-06c2b72eaa15 req-6cb7de92-df5e-4eaa-b762-21412f3b4b86 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:10.248882 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-4a2310bc-f58a-4830-be54-06c2b72eaa15 req-6cb7de92-df5e-4eaa-b762-21412f3b4b86 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:10.292031 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-4a2310bc-f58a-4830-be54-06c2b72eaa15 req-6cb7de92-df5e-4eaa-b762-21412f3b4b86 service nova] Creating event network-vif-deleted:0b3dd5dc-f222-454e-b4a7-c00075b3585f for instance d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 on hv-cinder-85394 Aug 22 17:32:10.303913 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-4a2310bc-f58a-4830-be54-06c2b72eaa15 req-6cb7de92-df5e-4eaa-b762-21412f3b4b86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134824 Aug 22 17:32:10.306076 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 204/420] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:32:11.048208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-025b51f7-d58c-45cd-a471-2bc657c07238 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:11.049347 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-025b51f7-d58c-45cd-a471-2bc657c07238 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:11.076667 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=60 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:11.085046 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-025b51f7-d58c-45cd-a471-2bc657c07238 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:11.086329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-025b51f7-d58c-45cd-a471-2bc657c07238 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:11.087236 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-025b51f7-d58c-45cd-a471-2bc657c07238 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:11.088778 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-025b51f7-d58c-45cd-a471-2bc657c07238 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:11.089553 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-025b51f7-d58c-45cd-a471-2bc657c07238 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:11.097131 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-025b51f7-d58c-45cd-a471-2bc657c07238 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:11.192830 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-866bec8a-b0e8-43e2-b0f0-f51fb08ca3e8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:11.198982 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-866bec8a-b0e8-43e2-b0f0-f51fb08ca3e8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:11.241659 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866bec8a-b0e8-43e2-b0f0-f51fb08ca3e8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:11.242615 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866bec8a-b0e8-43e2-b0f0-f51fb08ca3e8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:11.243456 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866bec8a-b0e8-43e2-b0f0-f51fb08ca3e8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:11.244819 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866bec8a-b0e8-43e2-b0f0-f51fb08ca3e8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:11.245649 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866bec8a-b0e8-43e2-b0f0-f51fb08ca3e8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:11.260916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866bec8a-b0e8-43e2-b0f0-f51fb08ca3e8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:11.364993 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866bec8a-b0e8-43e2-b0f0-f51fb08ca3e8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:11.365857 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866bec8a-b0e8-43e2-b0f0-f51fb08ca3e8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:11.366738 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-866bec8a-b0e8-43e2-b0f0-f51fb08ca3e8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:11.367585 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-866bec8a-b0e8-43e2-b0f0-f51fb08ca3e8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lazy-loading 'fault' on Instance uuid d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:32:11.449769 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-866bec8a-b0e8-43e2-b0f0-f51fb08ca3e8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:11.460401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-866bec8a-b0e8-43e2-b0f0-f51fb08ca3e8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 200 len: 1304 microversion: 2.1 time: 0.291323 Aug 22 17:32:11.460862 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 205/421] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:11 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 1304 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:11.541972 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-025b51f7-d58c-45cd-a471-2bc657c07238 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:11.554800 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-025b51f7-d58c-45cd-a471-2bc657c07238 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:11.556711 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-025b51f7-d58c-45cd-a471-2bc657c07238 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:11.558148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-025b51f7-d58c-45cd-a471-2bc657c07238 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1738 microversion: 2.20 time: 0.517873 Aug 22 17:32:11.559671 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 217/422] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:11 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1738 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:12.499850 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-da882fe0-a086-44d5-80e6-397dbf771d09 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:12.500649 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-da882fe0-a086-44d5-80e6-397dbf771d09 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: d2ad1a61-a52e-40b1-b0fa-2055f52a7b91] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:12.515914 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-da882fe0-a086-44d5-80e6-397dbf771d09 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:12.516094 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-da882fe0-a086-44d5-80e6-397dbf771d09 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:12.516519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-da882fe0-a086-44d5-80e6-397dbf771d09 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:12.517264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-da882fe0-a086-44d5-80e6-397dbf771d09 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:12.517726 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-da882fe0-a086-44d5-80e6-397dbf771d09 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:12.518150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-da882fe0-a086-44d5-80e6-397dbf771d09 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:12.553176 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-da882fe0-a086-44d5-80e6-397dbf771d09 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] HTTP exception thrown: Instance d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 could not be found. Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-da882fe0-a086-44d5-80e6-397dbf771d09 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Request method failure captured: Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 HTTP/1.1 Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA716LLhjm8gYSSqj_4RWRZ61OOeFr15nkUG8zL42MpJe-LADantwLfqF7r-XKH9YBKll9jyslvF14GJSa33vcy_5flJTR6jj16wNr7qd-97xvRg77IjzdQJkzd5vGkEXINJHoZBTAatq49KWx_9hQbcqbRXhG7zIwmmWA0sAXcW3BLw Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 7508a86facdb4ff98b171aa75962dde5 Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-VolumesActionsTest-287805984 Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:32:12.554912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:32:12.556401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7508a86facdb4ff98b171aa75962dde5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7508a86facdb4ff98b171aa75962dde5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7508a86facdb4ff98b171aa75962dde5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7508a86facdb4ff98b171aa75962dde5", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:32:12.556401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-VolumesActionsTest-287805984 Aug 22 17:32:12.556401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 7508a86facdb4ff98b171aa75962dde5 Aug 22 17:32:12.556401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-VolumesActionsTest-287805984 Aug 22 17:32:12.556401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-VolumesActionsTest-287805984-project Aug 22 17:32:12.556401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:32:12.556401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:32:12.556401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: 2351ea9262c44d74827e79231d1813c6 Aug 22 17:32:12.556401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-VolumesActionsTest-287805984-project Aug 22 17:32:12.556401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:32:12.556401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 could not be found. Aug 22 17:32:12.556401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': 'd2ad1a61-a52e-40b1-b0fa-2055f52a7b91'} Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 could not be found. Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:32:12.557361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 could not be found. Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 could not be found. Aug 22 17:32:12.559210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:32:12.560942 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-da882fe0-a086-44d5-80e6-397dbf771d09 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Returning 404 to user: Instance d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:32:12.560942 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-da882fe0-a086-44d5-80e6-397dbf771d09 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91" status: 404 len: 111 microversion: 2.1 time: 0.061602 Aug 22 17:32:12.560942 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 206/423] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:12 2022] GET /compute/v2.1/servers/d2ad1a61-a52e-40b1-b0fa-2055f52a7b91 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:32:12.599789 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-33644dd7-f5f2-460a-a77d-8386fa8cb35e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:12.600411 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-33644dd7-f5f2-460a-a77d-8386fa8cb35e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:12.611099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-33644dd7-f5f2-460a-a77d-8386fa8cb35e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:12.611689 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-33644dd7-f5f2-460a-a77d-8386fa8cb35e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:12.612145 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-33644dd7-f5f2-460a-a77d-8386fa8cb35e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:12.612845 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-33644dd7-f5f2-460a-a77d-8386fa8cb35e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:12.613303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-33644dd7-f5f2-460a-a77d-8386fa8cb35e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:12.613731 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-33644dd7-f5f2-460a-a77d-8386fa8cb35e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:12.854806 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-367299990", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "networks": [{"uuid": "9e24ded4-95b6-4afb-8069-6070a026a0a1"}]}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:12.954362 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.network.neutron [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] validate_networks() for [('9e24ded4-95b6-4afb-8069-6070a026a0a1', None, None, None, None, None)] {{(pid=121853) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:32:13.088926 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-33644dd7-f5f2-460a-a77d-8386fa8cb35e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:13.105303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-33644dd7-f5f2-460a-a77d-8386fa8cb35e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:13.108924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-33644dd7-f5f2-460a-a77d-8386fa8cb35e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:13.115143 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-33644dd7-f5f2-460a-a77d-8386fa8cb35e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1720 microversion: 2.20 time: 0.517175 Aug 22 17:32:13.115143 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 218/424] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:12 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1720 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:13.559257 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Flavor limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:32:13.561498 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Image limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:32:13.562672 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Flavor pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:32:13.563695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Image pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:32:13.564693 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:32:13.588046 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:13.589255 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:13.590212 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:13.592496 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:13.593583 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:13.594756 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:13.665456 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Getting quotas for project 7508a86facdb4ff98b171aa75962dde5. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:32:13.674823 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Getting quotas for user 2351ea9262c44d74827e79231d1813c6 and project 7508a86facdb4ff98b171aa75962dde5. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:32:13.701286 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Going to run 1 instances... {{(pid=121853) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:32:13.707113 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:32:13.838343 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-37cf8145-759b-42fe-bb88-b04a5578a8b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fd9c053-bd29-4360-bdd3-dcecd7d4bed6"}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:13.842663 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-37cf8145-759b-42fe-bb88-b04a5578a8b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:13.850927 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-37cf8145-759b-42fe-bb88-b04a5578a8b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:13.851804 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-37cf8145-759b-42fe-bb88-b04a5578a8b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:13.852431 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-37cf8145-759b-42fe-bb88-b04a5578a8b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:13.853501 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-37cf8145-759b-42fe-bb88-b04a5578a8b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:13.854237 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-37cf8145-759b-42fe-bb88-b04a5578a8b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:13.854706 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-37cf8145-759b-42fe-bb88-b04a5578a8b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:13.902850 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-35240759-8f5f-4510-bae3-ac7b42d5082a tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.051877 Aug 22 17:32:13.904351 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 207/425] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:32:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1054 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 17:32:13.917262 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-397a6e04-90f6-417f-870f-fe2168dbedbb tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:13.918409 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-397a6e04-90f6-417f-870f-fe2168dbedbb tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:13.996440 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-397a6e04-90f6-417f-870f-fe2168dbedbb tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:14.006771 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-397a6e04-90f6-417f-870f-fe2168dbedbb tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1213 microversion: 2.1 time: 0.094123 Aug 22 17:32:14.021035 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 208/426] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:13 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:14.139264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-fdb185fb-3a01-4a81-a717-918e77c954f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:14.139891 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-fdb185fb-3a01-4a81-a717-918e77c954f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:14.152228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fdb185fb-3a01-4a81-a717-918e77c954f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:14.152751 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fdb185fb-3a01-4a81-a717-918e77c954f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:14.153204 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fdb185fb-3a01-4a81-a717-918e77c954f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:14.154578 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fdb185fb-3a01-4a81-a717-918e77c954f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:14.155060 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fdb185fb-3a01-4a81-a717-918e77c954f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:14.158636 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fdb185fb-3a01-4a81-a717-918e77c954f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:14.642311 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-fdb185fb-3a01-4a81-a717-918e77c954f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:14.680628 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-fdb185fb-3a01-4a81-a717-918e77c954f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:14.689834 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-fdb185fb-3a01-4a81-a717-918e77c954f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:14.695715 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-fdb185fb-3a01-4a81-a717-918e77c954f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1720 microversion: 2.20 time: 0.561069 Aug 22 17:32:14.705150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 209/427] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:14 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1720 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:32:14.926784 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-35a0603f-e29d-4b6a-b5f5-4fc06b91d12d req-ea73896d-7b44-490a-9494-80f82463abf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb3959b-fd48-4a97-81d0-5b74ec4cfd32", "name": "network-vif-unplugged", "status": "completed", "tag": "703038a4-7ff6-4222-b6d6-2865ce69bda5"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:14.956604 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-35a0603f-e29d-4b6a-b5f5-4fc06b91d12d req-ea73896d-7b44-490a-9494-80f82463abf5 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:14.957651 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-35a0603f-e29d-4b6a-b5f5-4fc06b91d12d req-ea73896d-7b44-490a-9494-80f82463abf5 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:14.958381 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-35a0603f-e29d-4b6a-b5f5-4fc06b91d12d req-ea73896d-7b44-490a-9494-80f82463abf5 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:14.976107 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-35a0603f-e29d-4b6a-b5f5-4fc06b91d12d req-ea73896d-7b44-490a-9494-80f82463abf5 service nova] Creating event network-vif-unplugged:703038a4-7ff6-4222-b6d6-2865ce69bda5 for instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 on hv-cinder-85394 Aug 22 17:32:14.983626 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-35a0603f-e29d-4b6a-b5f5-4fc06b91d12d req-ea73896d-7b44-490a-9494-80f82463abf5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065529 Aug 22 17:32:14.985127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 210/428] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:32:15.033963 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a6b3e694-30bf-4591-a288-606ff2f75786 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:15.035567 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a6b3e694-30bf-4591-a288-606ff2f75786 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:15.194332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a6b3e694-30bf-4591-a288-606ff2f75786 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:15.218012 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a6b3e694-30bf-4591-a288-606ff2f75786 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1213 microversion: 2.1 time: 0.192214 Aug 22 17:32:15.219891 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 211/429] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:15 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1213 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:15.749437 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4d67c8ee-d6b1-448a-aa33-7e1b99113df9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:15.750708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4d67c8ee-d6b1-448a-aa33-7e1b99113df9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:15.768176 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d67c8ee-d6b1-448a-aa33-7e1b99113df9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:15.769495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d67c8ee-d6b1-448a-aa33-7e1b99113df9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:15.770814 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d67c8ee-d6b1-448a-aa33-7e1b99113df9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:15.776405 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d67c8ee-d6b1-448a-aa33-7e1b99113df9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:15.777467 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d67c8ee-d6b1-448a-aa33-7e1b99113df9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:15.779148 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d67c8ee-d6b1-448a-aa33-7e1b99113df9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:16.069225 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4d67c8ee-d6b1-448a-aa33-7e1b99113df9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:16.085194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4d67c8ee-d6b1-448a-aa33-7e1b99113df9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:16.085194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4d67c8ee-d6b1-448a-aa33-7e1b99113df9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:16.086961 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4d67c8ee-d6b1-448a-aa33-7e1b99113df9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1720 microversion: 2.20 time: 0.345170 Aug 22 17:32:16.087942 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 212/430] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:15 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1720 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:16.243007 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-11816e74-27c6-4e79-9b2e-73fb3bcf12b4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:16.243634 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-11816e74-27c6-4e79-9b2e-73fb3bcf12b4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:16.255197 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-11816e74-27c6-4e79-9b2e-73fb3bcf12b4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:16.255695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-11816e74-27c6-4e79-9b2e-73fb3bcf12b4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:16.256257 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-11816e74-27c6-4e79-9b2e-73fb3bcf12b4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:16.257017 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-11816e74-27c6-4e79-9b2e-73fb3bcf12b4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:16.257485 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-11816e74-27c6-4e79-9b2e-73fb3bcf12b4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:16.257960 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-11816e74-27c6-4e79-9b2e-73fb3bcf12b4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:16.347108 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-11816e74-27c6-4e79-9b2e-73fb3bcf12b4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:16.357029 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-11816e74-27c6-4e79-9b2e-73fb3bcf12b4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1217 microversion: 2.1 time: 0.118000 Aug 22 17:32:16.358332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 213/431] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:16 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1217 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:16.419982 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-37cf8145-759b-42fe-bb88-b04a5578a8b9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "POST /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.877919 Aug 22 17:32:16.420675 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 219/432] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 22 17:32:13 2022] POST /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-volume_attachments => generated 194 bytes in 2884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:32:17.118390 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b80961d4-79bf-4f1c-bd46-5887eb30fd2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:17.122000 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b80961d4-79bf-4f1c-bd46-5887eb30fd2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:17.139740 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b80961d4-79bf-4f1c-bd46-5887eb30fd2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:17.140595 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b80961d4-79bf-4f1c-bd46-5887eb30fd2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:17.141962 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b80961d4-79bf-4f1c-bd46-5887eb30fd2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:17.142999 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b80961d4-79bf-4f1c-bd46-5887eb30fd2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:17.143818 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b80961d4-79bf-4f1c-bd46-5887eb30fd2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:17.144642 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b80961d4-79bf-4f1c-bd46-5887eb30fd2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:17.377510 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b80961d4-79bf-4f1c-bd46-5887eb30fd2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:17.387016 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e8f46108-bbe2-430c-bc00-7018f2f43177 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:17.388824 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e8f46108-bbe2-430c-bc00-7018f2f43177 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:17.394230 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b80961d4-79bf-4f1c-bd46-5887eb30fd2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:17.396985 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b80961d4-79bf-4f1c-bd46-5887eb30fd2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:17.399147 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b80961d4-79bf-4f1c-bd46-5887eb30fd2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1663 microversion: 2.20 time: 0.286727 Aug 22 17:32:17.402361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 214/433] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:17 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1663 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:17.440240 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-136343c8-ebde-41b5-bd42-acad1c789297 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bdcd836d-948b-4eb4-8fe0-1454794a33ed"}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:17.444761 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e8f46108-bbe2-430c-bc00-7018f2f43177 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:17.445514 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-136343c8-ebde-41b5-bd42-acad1c789297 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:17.445760 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e8f46108-bbe2-430c-bc00-7018f2f43177 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:17.446556 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e8f46108-bbe2-430c-bc00-7018f2f43177 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:17.453200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e8f46108-bbe2-430c-bc00-7018f2f43177 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:17.455128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e8f46108-bbe2-430c-bc00-7018f2f43177 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:17.455944 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e8f46108-bbe2-430c-bc00-7018f2f43177 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:17.457439 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-136343c8-ebde-41b5-bd42-acad1c789297 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:17.458412 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-136343c8-ebde-41b5-bd42-acad1c789297 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:17.459131 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-136343c8-ebde-41b5-bd42-acad1c789297 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:17.460523 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-136343c8-ebde-41b5-bd42-acad1c789297 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:17.461629 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-136343c8-ebde-41b5-bd42-acad1c789297 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:17.467081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-136343c8-ebde-41b5-bd42-acad1c789297 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:17.602057 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e8f46108-bbe2-430c-bc00-7018f2f43177 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:17.619477 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e8f46108-bbe2-430c-bc00-7018f2f43177 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1265 microversion: 2.1 time: 0.242661 Aug 22 17:32:17.622838 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 220/434] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:17 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1265 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:18.654835 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8c0477c1-4ebd-4271-a382-ab294184d34b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:18.657805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8c0477c1-4ebd-4271-a382-ab294184d34b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:18.678829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c0477c1-4ebd-4271-a382-ab294184d34b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:18.679700 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c0477c1-4ebd-4271-a382-ab294184d34b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:18.681044 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c0477c1-4ebd-4271-a382-ab294184d34b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:18.682687 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c0477c1-4ebd-4271-a382-ab294184d34b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:18.683734 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c0477c1-4ebd-4271-a382-ab294184d34b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:18.684283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c0477c1-4ebd-4271-a382-ab294184d34b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:18.728193 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:18.896536 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8c0477c1-4ebd-4271-a382-ab294184d34b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:18.913981 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8c0477c1-4ebd-4271-a382-ab294184d34b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1273 microversion: 2.1 time: 0.263284 Aug 22 17:32:18.918180 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 221/435] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:18 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1273 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:19.900375 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-136343c8-ebde-41b5-bd42-acad1c789297 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "POST /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 2.472049 Aug 22 17:32:19.901016 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 215/436] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Aug 22 17:32:17 2022] POST /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/os-volume_attachments => generated 188 bytes in 2475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:32:19.964623 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ed8f2deb-3837-4b58-9f22-f5b658739aa8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:19.966232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ed8f2deb-3837-4b58-9f22-f5b658739aa8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:19.985864 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ed8f2deb-3837-4b58-9f22-f5b658739aa8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:19.987195 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ed8f2deb-3837-4b58-9f22-f5b658739aa8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:19.989838 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ed8f2deb-3837-4b58-9f22-f5b658739aa8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:19.993877 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ed8f2deb-3837-4b58-9f22-f5b658739aa8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:19.996176 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ed8f2deb-3837-4b58-9f22-f5b658739aa8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:19.998333 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ed8f2deb-3837-4b58-9f22-f5b658739aa8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:20.033899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:20.148762 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ed8f2deb-3837-4b58-9f22-f5b658739aa8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:20.168011 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ed8f2deb-3837-4b58-9f22-f5b658739aa8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1271 microversion: 2.1 time: 0.205093 Aug 22 17:32:20.175115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 222/437] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:19 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1271 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:20.327861 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-50b2535e-90f9-48b5-adb6-dab11282a283 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:20.333436 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-50b2535e-90f9-48b5-adb6-dab11282a283 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:20.337473 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-50b2535e-90f9-48b5-adb6-dab11282a283 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:20.338260 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-50b2535e-90f9-48b5-adb6-dab11282a283 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:20.338993 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-50b2535e-90f9-48b5-adb6-dab11282a283 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:20.339994 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-50b2535e-90f9-48b5-adb6-dab11282a283 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:20.340785 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-50b2535e-90f9-48b5-adb6-dab11282a283 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:20.341858 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-50b2535e-90f9-48b5-adb6-dab11282a283 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:20.399689 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-50b2535e-90f9-48b5-adb6-dab11282a283 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121853) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 17:32:20.767021 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-50b2535e-90f9-48b5-adb6-dab11282a283 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "POST /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/action" status: 202 len: 0 microversion: 2.20 time: 0.443283 Aug 22 17:32:20.767997 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 216/438] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 22 17:32:20 2022] POST /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:32:20.776280 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-375c2140-a062-4fb5-b2c9-433757922699 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:20.776912 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-375c2140-a062-4fb5-b2c9-433757922699 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:20.800208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-375c2140-a062-4fb5-b2c9-433757922699 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:20.801580 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-375c2140-a062-4fb5-b2c9-433757922699 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:20.803718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-375c2140-a062-4fb5-b2c9-433757922699 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:20.805854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-375c2140-a062-4fb5-b2c9-433757922699 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:20.806575 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-375c2140-a062-4fb5-b2c9-433757922699 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:20.810659 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-375c2140-a062-4fb5-b2c9-433757922699 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:21.076396 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-375c2140-a062-4fb5-b2c9-433757922699 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:21.094508 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-375c2140-a062-4fb5-b2c9-433757922699 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:21.096435 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-375c2140-a062-4fb5-b2c9-433757922699 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:21.106185 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-375c2140-a062-4fb5-b2c9-433757922699 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1749 microversion: 2.20 time: 0.333673 Aug 22 17:32:21.107677 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 223/439] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:20 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1749 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:32:21.202368 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0336383a-a6c3-4ed9-99a1-513eedccfce2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:21.203430 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0336383a-a6c3-4ed9-99a1-513eedccfce2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:21.220075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0336383a-a6c3-4ed9-99a1-513eedccfce2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:21.224111 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0336383a-a6c3-4ed9-99a1-513eedccfce2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:21.224111 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0336383a-a6c3-4ed9-99a1-513eedccfce2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:21.225518 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0336383a-a6c3-4ed9-99a1-513eedccfce2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:21.226557 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0336383a-a6c3-4ed9-99a1-513eedccfce2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:21.227716 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0336383a-a6c3-4ed9-99a1-513eedccfce2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:21.526588 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0336383a-a6c3-4ed9-99a1-513eedccfce2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:21.538568 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0336383a-a6c3-4ed9-99a1-513eedccfce2 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.343867 Aug 22 17:32:21.553001 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 217/440] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:21 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:22.152193 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-685c4da4-58ee-437a-baf6-951655d6850e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:22.154105 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-685c4da4-58ee-437a-baf6-951655d6850e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:22.162633 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-685c4da4-58ee-437a-baf6-951655d6850e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:22.163567 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-685c4da4-58ee-437a-baf6-951655d6850e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:22.164246 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-685c4da4-58ee-437a-baf6-951655d6850e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:22.165382 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-685c4da4-58ee-437a-baf6-951655d6850e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:22.166109 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-685c4da4-58ee-437a-baf6-951655d6850e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:22.166811 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-685c4da4-58ee-437a-baf6-951655d6850e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:22.518098 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-f805ff26-ad72-42e2-9190-e054a8c862b1 req-640652e4-c7ef-47cb-a651-f8d952192fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52dc487f-6ba1-4c5a-a5e8-c6f51d640339", "tag": "9e4c0787-69f9-41b8-8bc8-1ce5965ee3aa"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:22.553212 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-f805ff26-ad72-42e2-9190-e054a8c862b1 req-640652e4-c7ef-47cb-a651-f8d952192fc3 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:22.557780 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-f805ff26-ad72-42e2-9190-e054a8c862b1 req-640652e4-c7ef-47cb-a651-f8d952192fc3 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:22.562419 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-f805ff26-ad72-42e2-9190-e054a8c862b1 req-640652e4-c7ef-47cb-a651-f8d952192fc3 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:22.591489 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-f805ff26-ad72-42e2-9190-e054a8c862b1 req-640652e4-c7ef-47cb-a651-f8d952192fc3 service nova] Creating event network-changed:9e4c0787-69f9-41b8-8bc8-1ce5965ee3aa for instance 52dc487f-6ba1-4c5a-a5e8-c6f51d640339 on hv-cinder-85394 Aug 22 17:32:22.612461 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-f805ff26-ad72-42e2-9190-e054a8c862b1 req-640652e4-c7ef-47cb-a651-f8d952192fc3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231185 Aug 22 17:32:22.613545 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 218/441] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:32:22.640118 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-98453f98-5b25-4f8e-a1ca-3519fb32979f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:22.644459 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-685c4da4-58ee-437a-baf6-951655d6850e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:22.644905 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-98453f98-5b25-4f8e-a1ca-3519fb32979f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:22.658231 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-98453f98-5b25-4f8e-a1ca-3519fb32979f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:22.659298 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-98453f98-5b25-4f8e-a1ca-3519fb32979f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:22.659996 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-98453f98-5b25-4f8e-a1ca-3519fb32979f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:22.661666 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-98453f98-5b25-4f8e-a1ca-3519fb32979f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:22.662430 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-98453f98-5b25-4f8e-a1ca-3519fb32979f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:22.663141 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-98453f98-5b25-4f8e-a1ca-3519fb32979f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:22.664009 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-685c4da4-58ee-437a-baf6-951655d6850e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:22.666816 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-685c4da4-58ee-437a-baf6-951655d6850e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:22.668858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-685c4da4-58ee-437a-baf6-951655d6850e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1749 microversion: 2.20 time: 0.520390 Aug 22 17:32:22.682549 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 224/442] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:22 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1749 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:22.855771 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-98453f98-5b25-4f8e-a1ca-3519fb32979f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:22.866701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-98453f98-5b25-4f8e-a1ca-3519fb32979f tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.248058 Aug 22 17:32:22.879807 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 219/443] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:22 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:23.716719 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c8e3efc4-f3c9-4377-84bd-6fa14af58223 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:23.717969 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c8e3efc4-f3c9-4377-84bd-6fa14af58223 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:23.734450 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8e3efc4-f3c9-4377-84bd-6fa14af58223 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:23.735072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8e3efc4-f3c9-4377-84bd-6fa14af58223 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:23.735559 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8e3efc4-f3c9-4377-84bd-6fa14af58223 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:23.736497 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8e3efc4-f3c9-4377-84bd-6fa14af58223 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:23.737190 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8e3efc4-f3c9-4377-84bd-6fa14af58223 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:23.737634 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8e3efc4-f3c9-4377-84bd-6fa14af58223 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:23.890569 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-7cdb1dc2-de6b-4c40-94dd-ea858eca479b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:23.892022 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-7cdb1dc2-de6b-4c40-94dd-ea858eca479b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:23.895013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:23.901097 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7cdb1dc2-de6b-4c40-94dd-ea858eca479b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:23.901835 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7cdb1dc2-de6b-4c40-94dd-ea858eca479b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:23.902333 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7cdb1dc2-de6b-4c40-94dd-ea858eca479b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:23.903218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7cdb1dc2-de6b-4c40-94dd-ea858eca479b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:23.904339 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7cdb1dc2-de6b-4c40-94dd-ea858eca479b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:23.904992 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7cdb1dc2-de6b-4c40-94dd-ea858eca479b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:23.951922 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c8e3efc4-f3c9-4377-84bd-6fa14af58223 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:23.965757 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c8e3efc4-f3c9-4377-84bd-6fa14af58223 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:23.965757 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c8e3efc4-f3c9-4377-84bd-6fa14af58223 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:23.967566 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c8e3efc4-f3c9-4377-84bd-6fa14af58223 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1749 microversion: 2.20 time: 0.259421 Aug 22 17:32:23.968342 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 225/444] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:23 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1749 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:24.112630 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7cdb1dc2-de6b-4c40-94dd-ea858eca479b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:24.121004 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-7cdb1dc2-de6b-4c40-94dd-ea858eca479b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.235724 Aug 22 17:32:24.121586 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 220/445] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:23 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:25.014379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-95397871-f1cf-4167-ac90-55adaccca495 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:25.016112 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-95397871-f1cf-4167-ac90-55adaccca495 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:25.032171 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95397871-f1cf-4167-ac90-55adaccca495 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:25.033284 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95397871-f1cf-4167-ac90-55adaccca495 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:25.034344 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95397871-f1cf-4167-ac90-55adaccca495 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:25.035953 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95397871-f1cf-4167-ac90-55adaccca495 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:25.036983 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95397871-f1cf-4167-ac90-55adaccca495 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:25.037947 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-95397871-f1cf-4167-ac90-55adaccca495 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:25.147438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a08030b9-8c0f-4fb2-9e2c-0a6f7db13b45 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:25.151485 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a08030b9-8c0f-4fb2-9e2c-0a6f7db13b45 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:25.178827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a08030b9-8c0f-4fb2-9e2c-0a6f7db13b45 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:25.180127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a08030b9-8c0f-4fb2-9e2c-0a6f7db13b45 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:25.180899 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a08030b9-8c0f-4fb2-9e2c-0a6f7db13b45 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:25.182195 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a08030b9-8c0f-4fb2-9e2c-0a6f7db13b45 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:25.183036 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a08030b9-8c0f-4fb2-9e2c-0a6f7db13b45 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:25.183761 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a08030b9-8c0f-4fb2-9e2c-0a6f7db13b45 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:25.224544 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=10 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:25.323888 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-95397871-f1cf-4167-ac90-55adaccca495 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:25.340656 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-95397871-f1cf-4167-ac90-55adaccca495 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:25.343002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-95397871-f1cf-4167-ac90-55adaccca495 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:25.345306 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-95397871-f1cf-4167-ac90-55adaccca495 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1751 microversion: 2.20 time: 0.341504 Aug 22 17:32:25.346152 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 226/446] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:25 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1751 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:32:25.484432 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a08030b9-8c0f-4fb2-9e2c-0a6f7db13b45 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:25.511480 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a08030b9-8c0f-4fb2-9e2c-0a6f7db13b45 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.370835 Aug 22 17:32:25.517454 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 221/447] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:25 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:26.389765 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3a04d54b-f5d6-4c01-b056-fac0c7af9e2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:26.392689 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3a04d54b-f5d6-4c01-b056-fac0c7af9e2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:26.402542 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a04d54b-f5d6-4c01-b056-fac0c7af9e2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:26.403635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a04d54b-f5d6-4c01-b056-fac0c7af9e2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:26.404631 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a04d54b-f5d6-4c01-b056-fac0c7af9e2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:26.406346 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a04d54b-f5d6-4c01-b056-fac0c7af9e2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:26.407406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a04d54b-f5d6-4c01-b056-fac0c7af9e2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:26.408144 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a04d54b-f5d6-4c01-b056-fac0c7af9e2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:26.556287 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-fc96ee18-089b-418b-8603-cd8d0c582ac4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:26.559252 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-fc96ee18-089b-418b-8603-cd8d0c582ac4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:26.575758 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc96ee18-089b-418b-8603-cd8d0c582ac4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:26.578437 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc96ee18-089b-418b-8603-cd8d0c582ac4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:26.579612 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc96ee18-089b-418b-8603-cd8d0c582ac4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:26.581094 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc96ee18-089b-418b-8603-cd8d0c582ac4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:26.582197 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc96ee18-089b-418b-8603-cd8d0c582ac4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:26.583409 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc96ee18-089b-418b-8603-cd8d0c582ac4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:26.690718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3a04d54b-f5d6-4c01-b056-fac0c7af9e2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:26.717732 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3a04d54b-f5d6-4c01-b056-fac0c7af9e2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:26.724405 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3a04d54b-f5d6-4c01-b056-fac0c7af9e2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:26.726406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3a04d54b-f5d6-4c01-b056-fac0c7af9e2c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1751 microversion: 2.20 time: 0.344255 Aug 22 17:32:26.727138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 227/448] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:26 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1751 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:26.866818 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-fc96ee18-089b-418b-8603-cd8d0c582ac4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:26.880899 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-fc96ee18-089b-418b-8603-cd8d0c582ac4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.336079 Aug 22 17:32:26.882329 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 222/449] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:26 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:27.785272 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3030caf4-0405-4a09-b471-937f368bcd59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:27.791401 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3030caf4-0405-4a09-b471-937f368bcd59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:27.830791 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3030caf4-0405-4a09-b471-937f368bcd59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:27.830791 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3030caf4-0405-4a09-b471-937f368bcd59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:27.830791 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3030caf4-0405-4a09-b471-937f368bcd59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:27.830791 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3030caf4-0405-4a09-b471-937f368bcd59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:27.831576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3030caf4-0405-4a09-b471-937f368bcd59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:27.831576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3030caf4-0405-4a09-b471-937f368bcd59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:27.921113 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-fd6500ef-9539-408b-9564-f121caefa095 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:27.923278 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-fd6500ef-9539-408b-9564-f121caefa095 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:27.936925 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd6500ef-9539-408b-9564-f121caefa095 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:27.937621 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd6500ef-9539-408b-9564-f121caefa095 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:27.938169 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd6500ef-9539-408b-9564-f121caefa095 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:27.939375 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd6500ef-9539-408b-9564-f121caefa095 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:27.940191 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd6500ef-9539-408b-9564-f121caefa095 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:27.940856 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd6500ef-9539-408b-9564-f121caefa095 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:28.230827 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3030caf4-0405-4a09-b471-937f368bcd59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:28.246772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3030caf4-0405-4a09-b471-937f368bcd59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:28.252131 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3030caf4-0405-4a09-b471-937f368bcd59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:28.254421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3030caf4-0405-4a09-b471-937f368bcd59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1751 microversion: 2.20 time: 0.487522 Aug 22 17:32:28.259257 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 228/450] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:27 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1751 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:28.274114 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6cb584e6-0829-4a8c-848e-db1297adc230 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:28.283800 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6cb584e6-0829-4a8c-848e-db1297adc230 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:28.294798 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6cb584e6-0829-4a8c-848e-db1297adc230 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:28.295930 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6cb584e6-0829-4a8c-848e-db1297adc230 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:28.296586 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6cb584e6-0829-4a8c-848e-db1297adc230 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:28.297678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6cb584e6-0829-4a8c-848e-db1297adc230 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:28.298314 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6cb584e6-0829-4a8c-848e-db1297adc230 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:28.299075 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6cb584e6-0829-4a8c-848e-db1297adc230 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:28.333950 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-6cb584e6-0829-4a8c-848e-db1297adc230 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lazy-loading 'flavor' on Instance uuid 66347883-f0bf-4bbb-ba12-db82ee8d89c3 {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:32:28.352678 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-fd6500ef-9539-408b-9564-f121caefa095 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:28.370067 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-fd6500ef-9539-408b-9564-f121caefa095 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.463574 Aug 22 17:32:28.371840 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 223/451] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:27 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:28.907466 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6cb584e6-0829-4a8c-848e-db1297adc230 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "POST /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/action" status: 200 len: 32 microversion: 2.1 time: 0.645093 Aug 22 17:32:28.921839 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 229/452] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 22 17:32:28 2022] POST /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/action => generated 32 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:32:28.937603 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8511fb64-d15d-412d-bfca-8e1b83c1939c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:28.941551 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8511fb64-d15d-412d-bfca-8e1b83c1939c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:28.978317 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8511fb64-d15d-412d-bfca-8e1b83c1939c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:28.979199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8511fb64-d15d-412d-bfca-8e1b83c1939c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:28.986744 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8511fb64-d15d-412d-bfca-8e1b83c1939c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:28.993786 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8511fb64-d15d-412d-bfca-8e1b83c1939c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:28.993786 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8511fb64-d15d-412d-bfca-8e1b83c1939c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:29.002918 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8511fb64-d15d-412d-bfca-8e1b83c1939c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:29.282133 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8511fb64-d15d-412d-bfca-8e1b83c1939c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:29.289302 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8511fb64-d15d-412d-bfca-8e1b83c1939c tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.360124 Aug 22 17:32:29.290199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 224/453] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:28 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:29.303929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c451e7ff-77d7-44de-9b64-097bdfc6fb51 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:29.305525 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c451e7ff-77d7-44de-9b64-097bdfc6fb51 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:29.323839 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c451e7ff-77d7-44de-9b64-097bdfc6fb51 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:29.324709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c451e7ff-77d7-44de-9b64-097bdfc6fb51 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:29.326048 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c451e7ff-77d7-44de-9b64-097bdfc6fb51 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:29.327592 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c451e7ff-77d7-44de-9b64-097bdfc6fb51 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:29.328424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c451e7ff-77d7-44de-9b64-097bdfc6fb51 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:29.329196 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c451e7ff-77d7-44de-9b64-097bdfc6fb51 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:29.404668 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-18458eca-6fef-4fb0-af23-5f3264d89522 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:29.407288 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-18458eca-6fef-4fb0-af23-5f3264d89522 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:29.439852 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-18458eca-6fef-4fb0-af23-5f3264d89522 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:29.439852 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-18458eca-6fef-4fb0-af23-5f3264d89522 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:29.439852 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-18458eca-6fef-4fb0-af23-5f3264d89522 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:29.440657 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-18458eca-6fef-4fb0-af23-5f3264d89522 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:29.441493 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-18458eca-6fef-4fb0-af23-5f3264d89522 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:29.447504 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-18458eca-6fef-4fb0-af23-5f3264d89522 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:29.664812 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c451e7ff-77d7-44de-9b64-097bdfc6fb51 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:29.683325 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c451e7ff-77d7-44de-9b64-097bdfc6fb51 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:29.686811 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c451e7ff-77d7-44de-9b64-097bdfc6fb51 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:29.688274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c451e7ff-77d7-44de-9b64-097bdfc6fb51 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1751 microversion: 2.20 time: 0.393393 Aug 22 17:32:29.688959 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 230/454] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:29 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1751 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:29.820649 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-18458eca-6fef-4fb0-af23-5f3264d89522 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:29.838853 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-18458eca-6fef-4fb0-af23-5f3264d89522 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.443660 Aug 22 17:32:29.839804 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 225/455] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:29 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:29.976897 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-fcf30104-1543-458c-a886-cef73f4c329f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Action: 'create', calling method: .version_select at 0x7f0e5cf2e550>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-611220326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJo0SvHCCB6UT0vP7eWfrngHD/VLWv1BXPKOsbzx9ZBHdX9/+yVH20OJ/CR5XQVqWKBWppB9yf+1KEEh+9uSH1MVOED2UX1hen6oQyGKL0vH/7PfyDyir0i0Foow0PPYEA=="}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:30.017000 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-fcf30104-1543-458c-a886-cef73f4c329f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Getting quotas for project 11871f979145455499b30912da1abcfd. Resources: {'key_pairs'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:32:30.024271 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-fcf30104-1543-458c-a886-cef73f4c329f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Getting quotas for user aff4cd6b5ec14cb29813416b1d929333 and project 11871f979145455499b30912da1abcfd. Resources: {'key_pairs'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:32:30.147528 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-fcf30104-1543-458c-a886-cef73f4c329f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.177834 Aug 22 17:32:30.148500 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 231/456] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 22 17:32:29 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:32:30.331883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-dbca987c-6f8e-4b1d-9913-25a871a22013 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:30.334037 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-dbca987c-6f8e-4b1d-9913-25a871a22013 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:30.347755 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1745909260", "imageRef": "3dc58cec-7e7e-470e-9ff0-0fe2b819d1be", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-611220326", "networks": [{"uuid": "841182f0-7d54-4619-8e4c-08b29082853c"}]}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:30.352273 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dbca987c-6f8e-4b1d-9913-25a871a22013 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:30.353514 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dbca987c-6f8e-4b1d-9913-25a871a22013 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:30.354276 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dbca987c-6f8e-4b1d-9913-25a871a22013 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:30.355842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dbca987c-6f8e-4b1d-9913-25a871a22013 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:30.357521 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dbca987c-6f8e-4b1d-9913-25a871a22013 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:30.358304 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dbca987c-6f8e-4b1d-9913-25a871a22013 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:30.425797 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.network.neutron [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] validate_networks() for [('841182f0-7d54-4619-8e4c-08b29082853c', None, None, None, None, None)] {{(pid=121852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:32:30.697601 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-dbca987c-6f8e-4b1d-9913-25a871a22013 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:30.710450 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-dbca987c-6f8e-4b1d-9913-25a871a22013 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.386286 Aug 22 17:32:30.714001 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 226/457] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:30 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:30.721592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4c591e91-2ed9-4ef0-9e2b-7970af89c30a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:30.723487 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4c591e91-2ed9-4ef0-9e2b-7970af89c30a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:30.751974 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4c591e91-2ed9-4ef0-9e2b-7970af89c30a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:30.755760 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4c591e91-2ed9-4ef0-9e2b-7970af89c30a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:30.755760 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4c591e91-2ed9-4ef0-9e2b-7970af89c30a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:30.755760 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4c591e91-2ed9-4ef0-9e2b-7970af89c30a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:30.755760 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4c591e91-2ed9-4ef0-9e2b-7970af89c30a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:30.756381 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4c591e91-2ed9-4ef0-9e2b-7970af89c30a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:31.135046 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Flavor limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:32:31.137227 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Image limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:32:31.139912 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Flavor pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:32:31.142050 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Image pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:32:31.144838 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:32:31.148311 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4c591e91-2ed9-4ef0-9e2b-7970af89c30a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:31.162839 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:31.163787 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:31.164028 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4c591e91-2ed9-4ef0-9e2b-7970af89c30a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:31.164531 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:31.165861 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4c591e91-2ed9-4ef0-9e2b-7970af89c30a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:31.166029 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:31.166813 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:31.167121 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4c591e91-2ed9-4ef0-9e2b-7970af89c30a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.454198 Aug 22 17:32:31.167924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:31.168062 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 227/458] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:30 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:31.186062 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1e25be9c-8042-4af3-a545-c0192b4032e3 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:31.186737 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1e25be9c-8042-4af3-a545-c0192b4032e3 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:31.195757 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1e25be9c-8042-4af3-a545-c0192b4032e3 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:31.197397 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1e25be9c-8042-4af3-a545-c0192b4032e3 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:31.198472 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1e25be9c-8042-4af3-a545-c0192b4032e3 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:31.198987 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1e25be9c-8042-4af3-a545-c0192b4032e3 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:31.199469 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1e25be9c-8042-4af3-a545-c0192b4032e3 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:31.200208 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1e25be9c-8042-4af3-a545-c0192b4032e3 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:31.211459 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Getting quotas for project 11871f979145455499b30912da1abcfd. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:32:31.220223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Getting quotas for user aff4cd6b5ec14cb29813416b1d929333 and project 11871f979145455499b30912da1abcfd. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:32:31.245351 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Going to run 1 instances... {{(pid=121852) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:32:31.250681 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3dc58cec-7e7e-470e-9ff0-0fe2b819d1be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:32:31.409932 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e9b1dd95-6553-4d41-aa54-69de59046a81 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.067377 Aug 22 17:32:31.411289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 232/459] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:32:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 17:32:31.418038 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-32a1c4bd-44f3-4ebf-a21e-a4a8ba7bf620 req-38bebd5d-f7a6-4090-b1dd-771d777bfb8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52dc487f-6ba1-4c5a-a5e8-c6f51d640339", "name": "network-vif-plugged", "status": "completed", "tag": "9e4c0787-69f9-41b8-8bc8-1ce5965ee3aa"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:31.430525 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-32a1c4bd-44f3-4ebf-a21e-a4a8ba7bf620 req-38bebd5d-f7a6-4090-b1dd-771d777bfb8b service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:31.431307 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-32a1c4bd-44f3-4ebf-a21e-a4a8ba7bf620 req-38bebd5d-f7a6-4090-b1dd-771d777bfb8b service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:31.431847 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-32a1c4bd-44f3-4ebf-a21e-a4a8ba7bf620 req-38bebd5d-f7a6-4090-b1dd-771d777bfb8b service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:31.447899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-32a1c4bd-44f3-4ebf-a21e-a4a8ba7bf620 req-38bebd5d-f7a6-4090-b1dd-771d777bfb8b service nova] Creating event network-vif-plugged:9e4c0787-69f9-41b8-8bc8-1ce5965ee3aa for instance 52dc487f-6ba1-4c5a-a5e8-c6f51d640339 on hv-cinder-85394 Aug 22 17:32:31.455845 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-32a1c4bd-44f3-4ebf-a21e-a4a8ba7bf620 req-38bebd5d-f7a6-4090-b1dd-771d777bfb8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041153 Aug 22 17:32:31.455845 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 233/460] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:32:31.462461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-240fa53a-afb7-4ccd-934a-7f0fd57a1396 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:31.463426 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-240fa53a-afb7-4ccd-934a-7f0fd57a1396 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:31.496584 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1e25be9c-8042-4af3-a545-c0192b4032e3 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:31.524333 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1e25be9c-8042-4af3-a545-c0192b4032e3 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.355006 Aug 22 17:32:31.525359 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 228/461] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:31 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:31.597902 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-240fa53a-afb7-4ccd-934a-7f0fd57a1396 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:31.611602 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-240fa53a-afb7-4ccd-934a-7f0fd57a1396 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1258 microversion: 2.1 time: 0.153111 Aug 22 17:32:31.613702 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 234/462] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:31 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:31.753415 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c12fe60d-5eac-4afc-aeec-5eb0f31beef9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:31.754580 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c12fe60d-5eac-4afc-aeec-5eb0f31beef9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:31.766327 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c12fe60d-5eac-4afc-aeec-5eb0f31beef9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:31.775064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c12fe60d-5eac-4afc-aeec-5eb0f31beef9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:31.775064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c12fe60d-5eac-4afc-aeec-5eb0f31beef9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:31.775064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c12fe60d-5eac-4afc-aeec-5eb0f31beef9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:31.775064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c12fe60d-5eac-4afc-aeec-5eb0f31beef9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:31.775801 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c12fe60d-5eac-4afc-aeec-5eb0f31beef9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:32.006864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c12fe60d-5eac-4afc-aeec-5eb0f31beef9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:32.016702 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c12fe60d-5eac-4afc-aeec-5eb0f31beef9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.271102 Aug 22 17:32:32.017399 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 229/463] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:31 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:32.212537 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b7b2e219-725f-43b3-9ee1-da4ea95ebbe2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:32.213700 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b7b2e219-725f-43b3-9ee1-da4ea95ebbe2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:32.226852 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b7b2e219-725f-43b3-9ee1-da4ea95ebbe2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:32.227767 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b7b2e219-725f-43b3-9ee1-da4ea95ebbe2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:32.229747 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b7b2e219-725f-43b3-9ee1-da4ea95ebbe2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:32.229747 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b7b2e219-725f-43b3-9ee1-da4ea95ebbe2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:32.230431 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b7b2e219-725f-43b3-9ee1-da4ea95ebbe2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:32.231330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b7b2e219-725f-43b3-9ee1-da4ea95ebbe2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:32.452965 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b7b2e219-725f-43b3-9ee1-da4ea95ebbe2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:32.463434 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b7b2e219-725f-43b3-9ee1-da4ea95ebbe2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:32.464983 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b7b2e219-725f-43b3-9ee1-da4ea95ebbe2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:32.466840 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b7b2e219-725f-43b3-9ee1-da4ea95ebbe2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.262048 Aug 22 17:32:32.467572 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 235/464] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:32 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:32.557588 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-36952b1d-225b-4bb6-9c1f-2f0dae1cf38e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:32.558245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-36952b1d-225b-4bb6-9c1f-2f0dae1cf38e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:32.566567 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-36952b1d-225b-4bb6-9c1f-2f0dae1cf38e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:32.567083 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-36952b1d-225b-4bb6-9c1f-2f0dae1cf38e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:32.567520 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-36952b1d-225b-4bb6-9c1f-2f0dae1cf38e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:32.568236 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-36952b1d-225b-4bb6-9c1f-2f0dae1cf38e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:32.568726 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-36952b1d-225b-4bb6-9c1f-2f0dae1cf38e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:32.569149 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-36952b1d-225b-4bb6-9c1f-2f0dae1cf38e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:32.581176 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:32.650520 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-fbdb1bc4-2138-448b-9e1a-84d98aaedeb3 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:32.651700 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-fbdb1bc4-2138-448b-9e1a-84d98aaedeb3 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:32.727722 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-36952b1d-225b-4bb6-9c1f-2f0dae1cf38e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:32.737293 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-36952b1d-225b-4bb6-9c1f-2f0dae1cf38e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.183583 Aug 22 17:32:32.738651 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 230/465] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:32 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:32.753341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-fbdb1bc4-2138-448b-9e1a-84d98aaedeb3 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:32.762410 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-fbdb1bc4-2138-448b-9e1a-84d98aaedeb3 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1258 microversion: 2.1 time: 0.119242 Aug 22 17:32:32.763525 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 236/466] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:32 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1258 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:33.043887 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-558e8b77-b677-401d-9b61-6d24f7f4d922 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:33.044834 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-558e8b77-b677-401d-9b61-6d24f7f4d922 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:33.052246 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-558e8b77-b677-401d-9b61-6d24f7f4d922 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:33.054294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-558e8b77-b677-401d-9b61-6d24f7f4d922 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:33.054294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-558e8b77-b677-401d-9b61-6d24f7f4d922 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:33.054294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-558e8b77-b677-401d-9b61-6d24f7f4d922 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:33.054294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-558e8b77-b677-401d-9b61-6d24f7f4d922 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:33.055119 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-558e8b77-b677-401d-9b61-6d24f7f4d922 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:33.239169 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-558e8b77-b677-401d-9b61-6d24f7f4d922 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:33.257275 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-558e8b77-b677-401d-9b61-6d24f7f4d922 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.219336 Aug 22 17:32:33.258345 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 231/467] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:33 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:33.493719 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2eada28f-fab1-4e10-9461-37857e0087d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:33.494650 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-2eada28f-fab1-4e10-9461-37857e0087d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:33.505196 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2eada28f-fab1-4e10-9461-37857e0087d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:33.505901 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2eada28f-fab1-4e10-9461-37857e0087d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:33.506743 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2eada28f-fab1-4e10-9461-37857e0087d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:33.508096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2eada28f-fab1-4e10-9461-37857e0087d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:33.508898 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2eada28f-fab1-4e10-9461-37857e0087d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:33.509649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2eada28f-fab1-4e10-9461-37857e0087d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:33.737948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2eada28f-fab1-4e10-9461-37857e0087d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:33.771152 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e556525b-e126-4f3c-b3d0-98742d369565 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:33.773334 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e556525b-e126-4f3c-b3d0-98742d369565 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:33.781519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2eada28f-fab1-4e10-9461-37857e0087d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:33.790591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2eada28f-fab1-4e10-9461-37857e0087d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:33.793391 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2eada28f-fab1-4e10-9461-37857e0087d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.304928 Aug 22 17:32:33.799893 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e556525b-e126-4f3c-b3d0-98742d369565 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:33.822516 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 237/468] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:33 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:32:33.822825 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e556525b-e126-4f3c-b3d0-98742d369565 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:33.822825 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e556525b-e126-4f3c-b3d0-98742d369565 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:33.834703 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e556525b-e126-4f3c-b3d0-98742d369565 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:33.835365 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f19e0349-2bd4-4b3f-b394-bb24f1d6bef8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:33.836394 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e556525b-e126-4f3c-b3d0-98742d369565 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:33.836657 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f19e0349-2bd4-4b3f-b394-bb24f1d6bef8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:33.837945 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e556525b-e126-4f3c-b3d0-98742d369565 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:33.859732 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f19e0349-2bd4-4b3f-b394-bb24f1d6bef8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:33.864221 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f19e0349-2bd4-4b3f-b394-bb24f1d6bef8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:33.865537 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f19e0349-2bd4-4b3f-b394-bb24f1d6bef8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:33.867383 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f19e0349-2bd4-4b3f-b394-bb24f1d6bef8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:33.873664 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f19e0349-2bd4-4b3f-b394-bb24f1d6bef8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:33.874823 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f19e0349-2bd4-4b3f-b394-bb24f1d6bef8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:34.012128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f19e0349-2bd4-4b3f-b394-bb24f1d6bef8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:34.050206 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f19e0349-2bd4-4b3f-b394-bb24f1d6bef8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1262 microversion: 2.1 time: 0.215977 Aug 22 17:32:34.051941 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 238/469] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:33 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1262 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:34.140356 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e556525b-e126-4f3c-b3d0-98742d369565 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:34.156110 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e556525b-e126-4f3c-b3d0-98742d369565 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.397632 Aug 22 17:32:34.159715 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 232/470] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:33 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:34.299640 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c6138ab1-3d7d-4549-9dd3-0ad707545ac3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:34.301270 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c6138ab1-3d7d-4549-9dd3-0ad707545ac3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:34.317184 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6138ab1-3d7d-4549-9dd3-0ad707545ac3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:34.317953 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6138ab1-3d7d-4549-9dd3-0ad707545ac3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:34.320087 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6138ab1-3d7d-4549-9dd3-0ad707545ac3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:34.320087 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6138ab1-3d7d-4549-9dd3-0ad707545ac3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:34.324518 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6138ab1-3d7d-4549-9dd3-0ad707545ac3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:34.326060 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6138ab1-3d7d-4549-9dd3-0ad707545ac3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:34.565664 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c6138ab1-3d7d-4549-9dd3-0ad707545ac3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:34.575751 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c6138ab1-3d7d-4549-9dd3-0ad707545ac3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.283368 Aug 22 17:32:34.589886 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 239/471] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:34 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:34.842931 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-9b9da48f-bece-491c-b533-6945cc7a5d94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:34.843637 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9b9da48f-bece-491c-b533-6945cc7a5d94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:34.853348 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9b9da48f-bece-491c-b533-6945cc7a5d94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:34.854145 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9b9da48f-bece-491c-b533-6945cc7a5d94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:34.854714 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9b9da48f-bece-491c-b533-6945cc7a5d94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:34.855729 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9b9da48f-bece-491c-b533-6945cc7a5d94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:34.856626 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9b9da48f-bece-491c-b533-6945cc7a5d94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:34.857324 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9b9da48f-bece-491c-b533-6945cc7a5d94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:35.069804 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-9b9da48f-bece-491c-b533-6945cc7a5d94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:35.090412 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-9b9da48f-bece-491c-b533-6945cc7a5d94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:35.093893 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-9b9da48f-bece-491c-b533-6945cc7a5d94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:35.095282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-9b9da48f-bece-491c-b533-6945cc7a5d94 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.258483 Aug 22 17:32:35.096027 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 233/472] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:34 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:32:35.104042 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a6ca9c73-6beb-4da8-bb1b-9cf123fd4ba8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:35.109398 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a6ca9c73-6beb-4da8-bb1b-9cf123fd4ba8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:35.117880 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6ca9c73-6beb-4da8-bb1b-9cf123fd4ba8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:35.119437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6ca9c73-6beb-4da8-bb1b-9cf123fd4ba8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:35.120558 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6ca9c73-6beb-4da8-bb1b-9cf123fd4ba8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:35.123291 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6ca9c73-6beb-4da8-bb1b-9cf123fd4ba8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:35.124226 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6ca9c73-6beb-4da8-bb1b-9cf123fd4ba8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:35.125124 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6ca9c73-6beb-4da8-bb1b-9cf123fd4ba8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:35.202811 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-7e3f5be5-56a5-4c1f-94dc-d49c1e3b0bd8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:35.203477 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-7e3f5be5-56a5-4c1f-94dc-d49c1e3b0bd8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:35.218791 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e3f5be5-56a5-4c1f-94dc-d49c1e3b0bd8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:35.219331 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e3f5be5-56a5-4c1f-94dc-d49c1e3b0bd8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:35.219748 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e3f5be5-56a5-4c1f-94dc-d49c1e3b0bd8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:35.220487 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e3f5be5-56a5-4c1f-94dc-d49c1e3b0bd8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:35.220949 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e3f5be5-56a5-4c1f-94dc-d49c1e3b0bd8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:35.221379 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e3f5be5-56a5-4c1f-94dc-d49c1e3b0bd8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:35.225170 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a6ca9c73-6beb-4da8-bb1b-9cf123fd4ba8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:35.243435 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a6ca9c73-6beb-4da8-bb1b-9cf123fd4ba8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1262 microversion: 2.1 time: 0.142726 Aug 22 17:32:35.250557 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 240/473] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:35 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1262 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:35.429020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7e3f5be5-56a5-4c1f-94dc-d49c1e3b0bd8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:35.439094 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-7e3f5be5-56a5-4c1f-94dc-d49c1e3b0bd8 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.240921 Aug 22 17:32:35.440041 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 234/474] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:35 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:35.604290 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9d2b4823-ffdf-4fff-aa5e-ba7394572050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:35.605252 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9d2b4823-ffdf-4fff-aa5e-ba7394572050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:35.613361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d2b4823-ffdf-4fff-aa5e-ba7394572050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:35.613864 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d2b4823-ffdf-4fff-aa5e-ba7394572050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:35.614526 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d2b4823-ffdf-4fff-aa5e-ba7394572050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:35.615283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d2b4823-ffdf-4fff-aa5e-ba7394572050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:35.615757 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d2b4823-ffdf-4fff-aa5e-ba7394572050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:35.616219 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d2b4823-ffdf-4fff-aa5e-ba7394572050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:35.639625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:35.829145 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9d2b4823-ffdf-4fff-aa5e-ba7394572050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:35.839937 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9d2b4823-ffdf-4fff-aa5e-ba7394572050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.244797 Aug 22 17:32:35.841911 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 241/475] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:35 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:36.136362 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4d371bb1-d895-46bd-923a-15a3a2d8be0d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:36.137572 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4d371bb1-d895-46bd-923a-15a3a2d8be0d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:36.149636 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d371bb1-d895-46bd-923a-15a3a2d8be0d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:36.150462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d371bb1-d895-46bd-923a-15a3a2d8be0d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:36.151484 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d371bb1-d895-46bd-923a-15a3a2d8be0d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:36.152532 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d371bb1-d895-46bd-923a-15a3a2d8be0d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:36.154153 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d371bb1-d895-46bd-923a-15a3a2d8be0d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:36.155066 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d371bb1-d895-46bd-923a-15a3a2d8be0d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:36.274035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b024e782-fb01-4711-9f63-0482291fa530 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:36.274854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b024e782-fb01-4711-9f63-0482291fa530 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:36.283095 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b024e782-fb01-4711-9f63-0482291fa530 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:36.283515 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b024e782-fb01-4711-9f63-0482291fa530 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:36.283912 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b024e782-fb01-4711-9f63-0482291fa530 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:36.284887 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b024e782-fb01-4711-9f63-0482291fa530 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:36.285500 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b024e782-fb01-4711-9f63-0482291fa530 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:36.290997 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b024e782-fb01-4711-9f63-0482291fa530 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:36.404828 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4d371bb1-d895-46bd-923a-15a3a2d8be0d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:36.411523 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b024e782-fb01-4711-9f63-0482291fa530 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:36.414993 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4d371bb1-d895-46bd-923a-15a3a2d8be0d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:36.417281 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4d371bb1-d895-46bd-923a-15a3a2d8be0d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:36.419552 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4d371bb1-d895-46bd-923a-15a3a2d8be0d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.290376 Aug 22 17:32:36.420356 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 235/476] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:36 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:36.435818 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b024e782-fb01-4711-9f63-0482291fa530 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1262 microversion: 2.1 time: 0.165774 Aug 22 17:32:36.436967 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 242/477] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:36 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1262 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:36.464193 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6bdb3259-c6a8-49ba-848e-63538e5046c7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:36.465281 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6bdb3259-c6a8-49ba-848e-63538e5046c7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:36.478466 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6bdb3259-c6a8-49ba-848e-63538e5046c7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:36.479032 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6bdb3259-c6a8-49ba-848e-63538e5046c7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:36.479497 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6bdb3259-c6a8-49ba-848e-63538e5046c7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:36.480203 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6bdb3259-c6a8-49ba-848e-63538e5046c7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:36.480653 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6bdb3259-c6a8-49ba-848e-63538e5046c7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:36.481262 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6bdb3259-c6a8-49ba-848e-63538e5046c7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:36.699623 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6bdb3259-c6a8-49ba-848e-63538e5046c7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:36.715008 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6bdb3259-c6a8-49ba-848e-63538e5046c7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.256877 Aug 22 17:32:36.717951 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 236/478] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:36 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:36.875404 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e45b998e-7d07-404c-a57d-9ff39788aaf7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:36.876313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e45b998e-7d07-404c-a57d-9ff39788aaf7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:36.889431 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e45b998e-7d07-404c-a57d-9ff39788aaf7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:36.890354 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e45b998e-7d07-404c-a57d-9ff39788aaf7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:36.891138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e45b998e-7d07-404c-a57d-9ff39788aaf7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:36.892396 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e45b998e-7d07-404c-a57d-9ff39788aaf7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:36.893154 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e45b998e-7d07-404c-a57d-9ff39788aaf7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:36.893893 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e45b998e-7d07-404c-a57d-9ff39788aaf7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:37.142925 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e45b998e-7d07-404c-a57d-9ff39788aaf7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:37.160878 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e45b998e-7d07-404c-a57d-9ff39788aaf7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.294815 Aug 22 17:32:37.161974 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 243/479] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:36 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:37.443961 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-011d9669-c27f-4f9c-95ef-d67b40314306 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:37.445560 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-011d9669-c27f-4f9c-95ef-d67b40314306 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:37.454156 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-011d9669-c27f-4f9c-95ef-d67b40314306 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:37.454930 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-011d9669-c27f-4f9c-95ef-d67b40314306 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:37.455618 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-011d9669-c27f-4f9c-95ef-d67b40314306 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:37.456557 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-011d9669-c27f-4f9c-95ef-d67b40314306 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:37.457117 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-011d9669-c27f-4f9c-95ef-d67b40314306 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:37.458029 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-011d9669-c27f-4f9c-95ef-d67b40314306 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:37.466946 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d5130164-cf65-4342-a648-5337de0ee80d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:37.467860 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d5130164-cf65-4342-a648-5337de0ee80d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:37.481535 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d5130164-cf65-4342-a648-5337de0ee80d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:37.482517 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d5130164-cf65-4342-a648-5337de0ee80d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:37.483438 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d5130164-cf65-4342-a648-5337de0ee80d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:37.484938 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d5130164-cf65-4342-a648-5337de0ee80d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:37.485940 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d5130164-cf65-4342-a648-5337de0ee80d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:37.486855 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d5130164-cf65-4342-a648-5337de0ee80d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:37.657188 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-d5130164-cf65-4342-a648-5337de0ee80d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:37.669464 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d5130164-cf65-4342-a648-5337de0ee80d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1262 microversion: 2.1 time: 0.208833 Aug 22 17:32:37.670470 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 244/480] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:37 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1262 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:37.742326 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-dd0d34aa-2ee2-43a5-8b89-291b2e3be947 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:37.744080 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-dd0d34aa-2ee2-43a5-8b89-291b2e3be947 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:37.759388 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-dd0d34aa-2ee2-43a5-8b89-291b2e3be947 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:37.760099 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-011d9669-c27f-4f9c-95ef-d67b40314306 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:37.760331 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-dd0d34aa-2ee2-43a5-8b89-291b2e3be947 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:37.761514 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-dd0d34aa-2ee2-43a5-8b89-291b2e3be947 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:37.764035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-dd0d34aa-2ee2-43a5-8b89-291b2e3be947 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:37.765081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-dd0d34aa-2ee2-43a5-8b89-291b2e3be947 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:37.766137 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-dd0d34aa-2ee2-43a5-8b89-291b2e3be947 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:37.773861 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-011d9669-c27f-4f9c-95ef-d67b40314306 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:37.776034 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-011d9669-c27f-4f9c-95ef-d67b40314306 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:37.777389 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-011d9669-c27f-4f9c-95ef-d67b40314306 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.337500 Aug 22 17:32:37.778675 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 237/481] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:37 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:37.988642 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-dd0d34aa-2ee2-43a5-8b89-291b2e3be947 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:38.001565 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-dd0d34aa-2ee2-43a5-8b89-291b2e3be947 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.266148 Aug 22 17:32:38.003152 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 245/482] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:37 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:38.189042 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8ae75b6a-b4bf-4609-86af-e062172dafa4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:38.190133 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8ae75b6a-b4bf-4609-86af-e062172dafa4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:38.203248 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8ae75b6a-b4bf-4609-86af-e062172dafa4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:38.204688 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8ae75b6a-b4bf-4609-86af-e062172dafa4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:38.205500 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8ae75b6a-b4bf-4609-86af-e062172dafa4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:38.206708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8ae75b6a-b4bf-4609-86af-e062172dafa4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:38.207447 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8ae75b6a-b4bf-4609-86af-e062172dafa4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:38.208076 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8ae75b6a-b4bf-4609-86af-e062172dafa4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:38.480581 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8ae75b6a-b4bf-4609-86af-e062172dafa4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:38.492487 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8ae75b6a-b4bf-4609-86af-e062172dafa4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.310435 Aug 22 17:32:38.493437 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 238/483] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:38 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:38.696985 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9f11bd35-4c20-4621-82f5-cebd5b74260d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:38.698100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9f11bd35-4c20-4621-82f5-cebd5b74260d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:38.715565 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9f11bd35-4c20-4621-82f5-cebd5b74260d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:38.716274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9f11bd35-4c20-4621-82f5-cebd5b74260d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:38.716903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9f11bd35-4c20-4621-82f5-cebd5b74260d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:38.718044 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9f11bd35-4c20-4621-82f5-cebd5b74260d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:38.718752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9f11bd35-4c20-4621-82f5-cebd5b74260d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:38.719275 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9f11bd35-4c20-4621-82f5-cebd5b74260d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:38.797062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9f11bd35-4c20-4621-82f5-cebd5b74260d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:38.816446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9f11bd35-4c20-4621-82f5-cebd5b74260d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1262 microversion: 2.1 time: 0.124389 Aug 22 17:32:38.826059 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 246/484] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:38 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1262 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:38.827949 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-415dae5a-7926-4739-8ce1-79ba4cfc34b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:38.829029 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-415dae5a-7926-4739-8ce1-79ba4cfc34b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:38.854086 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-415dae5a-7926-4739-8ce1-79ba4cfc34b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:38.855781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-415dae5a-7926-4739-8ce1-79ba4cfc34b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:38.857514 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-415dae5a-7926-4739-8ce1-79ba4cfc34b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:38.859272 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-415dae5a-7926-4739-8ce1-79ba4cfc34b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:38.860528 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-415dae5a-7926-4739-8ce1-79ba4cfc34b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:38.861655 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-415dae5a-7926-4739-8ce1-79ba4cfc34b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:39.040521 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-07f043c2-9f62-4e7e-a2d1-7e1951376505 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:39.045541 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-07f043c2-9f62-4e7e-a2d1-7e1951376505 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:39.062403 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07f043c2-9f62-4e7e-a2d1-7e1951376505 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:39.064234 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07f043c2-9f62-4e7e-a2d1-7e1951376505 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:39.065109 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07f043c2-9f62-4e7e-a2d1-7e1951376505 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:39.066338 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07f043c2-9f62-4e7e-a2d1-7e1951376505 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:39.067576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07f043c2-9f62-4e7e-a2d1-7e1951376505 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:39.068603 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07f043c2-9f62-4e7e-a2d1-7e1951376505 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:39.197239 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-415dae5a-7926-4739-8ce1-79ba4cfc34b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:39.215271 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-415dae5a-7926-4739-8ce1-79ba4cfc34b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:39.221635 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-415dae5a-7926-4739-8ce1-79ba4cfc34b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:39.226145 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-415dae5a-7926-4739-8ce1-79ba4cfc34b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.409738 Aug 22 17:32:39.250529 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 239/485] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:38 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:32:39.413837 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-07f043c2-9f62-4e7e-a2d1-7e1951376505 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:39.424995 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-07f043c2-9f62-4e7e-a2d1-7e1951376505 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.393108 Aug 22 17:32:39.426116 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 247/486] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:39 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:39.525062 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0ce90dd0-55e5-4a04-a9ac-17a9e2e0a4c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:39.526150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0ce90dd0-55e5-4a04-a9ac-17a9e2e0a4c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:39.535875 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ce90dd0-55e5-4a04-a9ac-17a9e2e0a4c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:39.537074 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ce90dd0-55e5-4a04-a9ac-17a9e2e0a4c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:39.538090 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ce90dd0-55e5-4a04-a9ac-17a9e2e0a4c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:39.539644 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ce90dd0-55e5-4a04-a9ac-17a9e2e0a4c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:39.540673 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ce90dd0-55e5-4a04-a9ac-17a9e2e0a4c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:39.541830 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ce90dd0-55e5-4a04-a9ac-17a9e2e0a4c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:39.740471 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0ce90dd0-55e5-4a04-a9ac-17a9e2e0a4c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:39.751978 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0ce90dd0-55e5-4a04-a9ac-17a9e2e0a4c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.234147 Aug 22 17:32:39.752932 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 240/487] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:39 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:39.874556 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-7e024d5f-9b80-4c0d-b13a-0c9bf1b42f16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:39.875726 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-7e024d5f-9b80-4c0d-b13a-0c9bf1b42f16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:39.884817 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7e024d5f-9b80-4c0d-b13a-0c9bf1b42f16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:39.885925 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7e024d5f-9b80-4c0d-b13a-0c9bf1b42f16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:39.886955 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7e024d5f-9b80-4c0d-b13a-0c9bf1b42f16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:39.888916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7e024d5f-9b80-4c0d-b13a-0c9bf1b42f16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:39.889955 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7e024d5f-9b80-4c0d-b13a-0c9bf1b42f16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:39.890743 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7e024d5f-9b80-4c0d-b13a-0c9bf1b42f16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:39.995737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-7e024d5f-9b80-4c0d-b13a-0c9bf1b42f16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:40.006037 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-7e024d5f-9b80-4c0d-b13a-0c9bf1b42f16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1262 microversion: 2.1 time: 0.136987 Aug 22 17:32:40.010953 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 248/488] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:39 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1262 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:40.277439 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-893c5927-d46c-47bc-9fc8-4745985057c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:40.279813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-893c5927-d46c-47bc-9fc8-4745985057c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:40.282096 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:40.285982 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-893c5927-d46c-47bc-9fc8-4745985057c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:40.286512 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-893c5927-d46c-47bc-9fc8-4745985057c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:40.286943 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-893c5927-d46c-47bc-9fc8-4745985057c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:40.287670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-893c5927-d46c-47bc-9fc8-4745985057c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:40.288123 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-893c5927-d46c-47bc-9fc8-4745985057c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:40.288545 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-893c5927-d46c-47bc-9fc8-4745985057c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:40.455068 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a97541ae-a69c-4fc0-8d8e-d112db9353ca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:40.456206 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a97541ae-a69c-4fc0-8d8e-d112db9353ca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:40.479772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a97541ae-a69c-4fc0-8d8e-d112db9353ca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:40.480274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a97541ae-a69c-4fc0-8d8e-d112db9353ca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:40.481396 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a97541ae-a69c-4fc0-8d8e-d112db9353ca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:40.482498 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a97541ae-a69c-4fc0-8d8e-d112db9353ca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:40.483152 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a97541ae-a69c-4fc0-8d8e-d112db9353ca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:40.483755 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a97541ae-a69c-4fc0-8d8e-d112db9353ca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:40.572835 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-893c5927-d46c-47bc-9fc8-4745985057c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:40.595992 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-893c5927-d46c-47bc-9fc8-4745985057c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:40.600096 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-893c5927-d46c-47bc-9fc8-4745985057c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:40.603120 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-893c5927-d46c-47bc-9fc8-4745985057c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.329115 Aug 22 17:32:40.618522 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 241/489] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:40 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:32:40.782984 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f02c6e79-c77a-408f-85a9-7da3bc0feb9b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:40.784246 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f02c6e79-c77a-408f-85a9-7da3bc0feb9b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:40.795995 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f02c6e79-c77a-408f-85a9-7da3bc0feb9b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:40.796875 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f02c6e79-c77a-408f-85a9-7da3bc0feb9b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:40.797655 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f02c6e79-c77a-408f-85a9-7da3bc0feb9b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:40.804275 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a97541ae-a69c-4fc0-8d8e-d112db9353ca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:40.811252 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f02c6e79-c77a-408f-85a9-7da3bc0feb9b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:40.812226 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f02c6e79-c77a-408f-85a9-7da3bc0feb9b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:40.813026 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f02c6e79-c77a-408f-85a9-7da3bc0feb9b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:40.817479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a97541ae-a69c-4fc0-8d8e-d112db9353ca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.370387 Aug 22 17:32:40.818507 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 249/490] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:40 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:41.036473 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-749ad0b8-5a0f-4c16-ba8f-a33872aa8d64 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:41.037795 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-749ad0b8-5a0f-4c16-ba8f-a33872aa8d64 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:41.055325 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-749ad0b8-5a0f-4c16-ba8f-a33872aa8d64 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:41.056234 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-749ad0b8-5a0f-4c16-ba8f-a33872aa8d64 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:41.057199 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-749ad0b8-5a0f-4c16-ba8f-a33872aa8d64 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:41.058104 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-749ad0b8-5a0f-4c16-ba8f-a33872aa8d64 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:41.058989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-749ad0b8-5a0f-4c16-ba8f-a33872aa8d64 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:41.060390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-749ad0b8-5a0f-4c16-ba8f-a33872aa8d64 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:41.079436 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f02c6e79-c77a-408f-85a9-7da3bc0feb9b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:41.102069 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f02c6e79-c77a-408f-85a9-7da3bc0feb9b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.329131 Aug 22 17:32:41.103782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 242/491] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:40 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:41.189024 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-749ad0b8-5a0f-4c16-ba8f-a33872aa8d64 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:41.197351 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:41.204984 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-749ad0b8-5a0f-4c16-ba8f-a33872aa8d64 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1262 microversion: 2.1 time: 0.176627 Aug 22 17:32:41.206003 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 250/492] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:41 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1262 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:41.652707 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-7348b3e7-c566-41b9-a511-47ff2ca62f99 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:41.655066 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-7348b3e7-c566-41b9-a511-47ff2ca62f99 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:41.669937 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7348b3e7-c566-41b9-a511-47ff2ca62f99 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:41.672635 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7348b3e7-c566-41b9-a511-47ff2ca62f99 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:41.673852 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7348b3e7-c566-41b9-a511-47ff2ca62f99 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:41.674920 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7348b3e7-c566-41b9-a511-47ff2ca62f99 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:41.675910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7348b3e7-c566-41b9-a511-47ff2ca62f99 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:41.676635 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7348b3e7-c566-41b9-a511-47ff2ca62f99 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:41.858923 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-81e396f9-726f-4997-96ae-fec34d93ab58 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:41.860920 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-81e396f9-726f-4997-96ae-fec34d93ab58 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:41.890337 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:41.893617 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81e396f9-726f-4997-96ae-fec34d93ab58 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:41.894872 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81e396f9-726f-4997-96ae-fec34d93ab58 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:41.895774 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81e396f9-726f-4997-96ae-fec34d93ab58 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:41.897230 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81e396f9-726f-4997-96ae-fec34d93ab58 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:41.898464 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81e396f9-726f-4997-96ae-fec34d93ab58 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:41.899428 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81e396f9-726f-4997-96ae-fec34d93ab58 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:41.943534 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7348b3e7-c566-41b9-a511-47ff2ca62f99 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:41.961498 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7348b3e7-c566-41b9-a511-47ff2ca62f99 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:41.967374 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7348b3e7-c566-41b9-a511-47ff2ca62f99 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:41.970923 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-7348b3e7-c566-41b9-a511-47ff2ca62f99 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.327655 Aug 22 17:32:41.972440 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 243/493] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:41 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:42.129869 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ce0a2feb-1760-458e-905d-03f988d9b050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:42.130888 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ce0a2feb-1760-458e-905d-03f988d9b050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:42.144699 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce0a2feb-1760-458e-905d-03f988d9b050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:42.145533 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce0a2feb-1760-458e-905d-03f988d9b050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:42.146274 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce0a2feb-1760-458e-905d-03f988d9b050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:42.147540 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce0a2feb-1760-458e-905d-03f988d9b050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:42.148338 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce0a2feb-1760-458e-905d-03f988d9b050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:42.149139 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce0a2feb-1760-458e-905d-03f988d9b050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:42.166201 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-81e396f9-726f-4997-96ae-fec34d93ab58 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:42.180444 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-81e396f9-726f-4997-96ae-fec34d93ab58 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.326235 Aug 22 17:32:42.183591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 251/494] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:41 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:42.227964 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-92e3505b-8957-4708-90df-4f9ef94105f9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:42.228691 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-92e3505b-8957-4708-90df-4f9ef94105f9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:42.239464 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-92e3505b-8957-4708-90df-4f9ef94105f9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:42.240110 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-92e3505b-8957-4708-90df-4f9ef94105f9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:42.240645 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-92e3505b-8957-4708-90df-4f9ef94105f9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:42.241611 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-92e3505b-8957-4708-90df-4f9ef94105f9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:42.242179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-92e3505b-8957-4708-90df-4f9ef94105f9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:42.242752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-92e3505b-8957-4708-90df-4f9ef94105f9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:42.349155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-92e3505b-8957-4708-90df-4f9ef94105f9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:42.358229 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-92e3505b-8957-4708-90df-4f9ef94105f9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1262 microversion: 2.1 time: 0.134201 Aug 22 17:32:42.358863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 252/495] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:42 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1262 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:42.363250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ce0a2feb-1760-458e-905d-03f988d9b050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:42.374221 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ce0a2feb-1760-458e-905d-03f988d9b050 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.251406 Aug 22 17:32:42.375055 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 244/496] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:42 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:43.014882 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-aeb87ae7-85ae-4d4a-8c36-3d0a8a350cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:43.015862 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-aeb87ae7-85ae-4d4a-8c36-3d0a8a350cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:43.018196 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=14 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:43.024842 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aeb87ae7-85ae-4d4a-8c36-3d0a8a350cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:43.025383 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aeb87ae7-85ae-4d4a-8c36-3d0a8a350cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:43.026039 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aeb87ae7-85ae-4d4a-8c36-3d0a8a350cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:43.026963 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aeb87ae7-85ae-4d4a-8c36-3d0a8a350cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:43.027498 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aeb87ae7-85ae-4d4a-8c36-3d0a8a350cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:43.028012 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aeb87ae7-85ae-4d4a-8c36-3d0a8a350cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:43.217063 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1b69f384-e9fb-401e-91ca-03aec26eb17d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:43.218109 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1b69f384-e9fb-401e-91ca-03aec26eb17d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:43.225271 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b69f384-e9fb-401e-91ca-03aec26eb17d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:43.225767 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b69f384-e9fb-401e-91ca-03aec26eb17d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:43.226201 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b69f384-e9fb-401e-91ca-03aec26eb17d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:43.226989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b69f384-e9fb-401e-91ca-03aec26eb17d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:43.227447 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b69f384-e9fb-401e-91ca-03aec26eb17d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:43.227880 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b69f384-e9fb-401e-91ca-03aec26eb17d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:43.430212 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1b69f384-e9fb-401e-91ca-03aec26eb17d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:43.440896 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1b69f384-e9fb-401e-91ca-03aec26eb17d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.228839 Aug 22 17:32:43.441656 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 245/497] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:43 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:43.447847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-92351709-2c9d-4acd-9313-e97f9899216d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:43.448696 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-92351709-2c9d-4acd-9313-e97f9899216d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:43.448880 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-aeb87ae7-85ae-4d4a-8c36-3d0a8a350cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:43.458063 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-92351709-2c9d-4acd-9313-e97f9899216d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:43.458896 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-92351709-2c9d-4acd-9313-e97f9899216d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:43.459611 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-92351709-2c9d-4acd-9313-e97f9899216d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:43.460911 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-92351709-2c9d-4acd-9313-e97f9899216d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:43.461501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-92351709-2c9d-4acd-9313-e97f9899216d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:43.462233 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-92351709-2c9d-4acd-9313-e97f9899216d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:43.463464 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-aeb87ae7-85ae-4d4a-8c36-3d0a8a350cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:43.467449 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-aeb87ae7-85ae-4d4a-8c36-3d0a8a350cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:43.470159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-aeb87ae7-85ae-4d4a-8c36-3d0a8a350cd3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.460289 Aug 22 17:32:43.471567 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 253/498] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:43 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:43.481812 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f636c050-e761-43c6-ab8d-354c8214bf68 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:43.483516 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f636c050-e761-43c6-ab8d-354c8214bf68 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:43.494958 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f636c050-e761-43c6-ab8d-354c8214bf68 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:43.496309 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f636c050-e761-43c6-ab8d-354c8214bf68 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:43.497953 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f636c050-e761-43c6-ab8d-354c8214bf68 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:43.499551 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f636c050-e761-43c6-ab8d-354c8214bf68 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:43.500642 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f636c050-e761-43c6-ab8d-354c8214bf68 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:43.501477 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f636c050-e761-43c6-ab8d-354c8214bf68 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:43.562378 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-92351709-2c9d-4acd-9313-e97f9899216d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:43.566957 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=100 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:43.572276 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-92351709-2c9d-4acd-9313-e97f9899216d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1262 microversion: 2.1 time: 0.129355 Aug 22 17:32:43.576217 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 246/499] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:43 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1262 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:43.678838 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f636c050-e761-43c6-ab8d-354c8214bf68 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:43.688440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f636c050-e761-43c6-ab8d-354c8214bf68 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.214813 Aug 22 17:32:43.689096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 254/500] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:43 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:44.477136 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f133fd71-583f-4939-8659-49d3803518ab tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:44.477782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f133fd71-583f-4939-8659-49d3803518ab tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:44.485768 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f133fd71-583f-4939-8659-49d3803518ab tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:44.486264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f133fd71-583f-4939-8659-49d3803518ab tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:44.486743 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f133fd71-583f-4939-8659-49d3803518ab tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:44.487463 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f133fd71-583f-4939-8659-49d3803518ab tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:44.487927 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f133fd71-583f-4939-8659-49d3803518ab tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:44.488359 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f133fd71-583f-4939-8659-49d3803518ab tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:44.511799 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0e74cf6e-c0f3-41d0-a60a-42bb36373d98 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:44.514201 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0e74cf6e-c0f3-41d0-a60a-42bb36373d98 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:44.521737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e74cf6e-c0f3-41d0-a60a-42bb36373d98 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:44.522354 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e74cf6e-c0f3-41d0-a60a-42bb36373d98 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:44.522927 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e74cf6e-c0f3-41d0-a60a-42bb36373d98 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:44.523723 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e74cf6e-c0f3-41d0-a60a-42bb36373d98 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:44.524267 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e74cf6e-c0f3-41d0-a60a-42bb36373d98 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:44.524793 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e74cf6e-c0f3-41d0-a60a-42bb36373d98 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:44.677282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f133fd71-583f-4939-8659-49d3803518ab tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:44.692698 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f133fd71-583f-4939-8659-49d3803518ab tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.219761 Aug 22 17:32:44.693805 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 247/501] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:44 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:44.697050 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0e74cf6e-c0f3-41d0-a60a-42bb36373d98 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:44.701879 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8d60f396-f3f7-4384-bf9b-533a12aa2dca tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:44.702790 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8d60f396-f3f7-4384-bf9b-533a12aa2dca tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:44.708428 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0e74cf6e-c0f3-41d0-a60a-42bb36373d98 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:44.710199 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0e74cf6e-c0f3-41d0-a60a-42bb36373d98 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:44.711164 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8d60f396-f3f7-4384-bf9b-533a12aa2dca tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:44.711604 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0e74cf6e-c0f3-41d0-a60a-42bb36373d98 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.205012 Aug 22 17:32:44.711895 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8d60f396-f3f7-4384-bf9b-533a12aa2dca tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:44.712436 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8d60f396-f3f7-4384-bf9b-533a12aa2dca tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:44.712670 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 255/502] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:44 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:32:44.713312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8d60f396-f3f7-4384-bf9b-533a12aa2dca tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:44.713942 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8d60f396-f3f7-4384-bf9b-533a12aa2dca tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:44.714679 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8d60f396-f3f7-4384-bf9b-533a12aa2dca tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:44.718423 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-fb85de3c-7196-4668-af1e-6c3d9f07044b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:44.719160 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-fb85de3c-7196-4668-af1e-6c3d9f07044b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:44.725962 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fb85de3c-7196-4668-af1e-6c3d9f07044b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:44.726609 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fb85de3c-7196-4668-af1e-6c3d9f07044b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:44.727123 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fb85de3c-7196-4668-af1e-6c3d9f07044b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:44.728122 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fb85de3c-7196-4668-af1e-6c3d9f07044b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:44.728659 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fb85de3c-7196-4668-af1e-6c3d9f07044b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:44.729095 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fb85de3c-7196-4668-af1e-6c3d9f07044b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:44.789018 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8d60f396-f3f7-4384-bf9b-533a12aa2dca tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:44.798148 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8d60f396-f3f7-4384-bf9b-533a12aa2dca tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1262 microversion: 2.1 time: 0.102841 Aug 22 17:32:44.798837 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 248/503] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:44 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1262 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:44.873474 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-fb85de3c-7196-4668-af1e-6c3d9f07044b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:44.882406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-fb85de3c-7196-4668-af1e-6c3d9f07044b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.168574 Aug 22 17:32:44.883051 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 256/504] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:44 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:45.720317 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2c112d95-7d37-4582-be0b-6d8ee4b198cb tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:45.720960 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2c112d95-7d37-4582-be0b-6d8ee4b198cb tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:45.728533 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c112d95-7d37-4582-be0b-6d8ee4b198cb tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:45.729122 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c112d95-7d37-4582-be0b-6d8ee4b198cb tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:45.729621 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c112d95-7d37-4582-be0b-6d8ee4b198cb tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:45.730360 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c112d95-7d37-4582-be0b-6d8ee4b198cb tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:45.731470 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c112d95-7d37-4582-be0b-6d8ee4b198cb tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:45.732350 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c112d95-7d37-4582-be0b-6d8ee4b198cb tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:45.738225 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0814c335-1f74-4d7a-a8d5-2bea4dab0142 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:45.738992 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0814c335-1f74-4d7a-a8d5-2bea4dab0142 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:45.749302 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0814c335-1f74-4d7a-a8d5-2bea4dab0142 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:45.751389 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0814c335-1f74-4d7a-a8d5-2bea4dab0142 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:45.752052 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0814c335-1f74-4d7a-a8d5-2bea4dab0142 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:45.753172 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0814c335-1f74-4d7a-a8d5-2bea4dab0142 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:45.753884 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0814c335-1f74-4d7a-a8d5-2bea4dab0142 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:45.754415 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0814c335-1f74-4d7a-a8d5-2bea4dab0142 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:45.912352 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0814c335-1f74-4d7a-a8d5-2bea4dab0142 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:45.923993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0814c335-1f74-4d7a-a8d5-2bea4dab0142 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:45.925764 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0814c335-1f74-4d7a-a8d5-2bea4dab0142 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:45.927518 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0814c335-1f74-4d7a-a8d5-2bea4dab0142 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.193419 Aug 22 17:32:45.928325 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 257/505] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:45 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:32:45.933476 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2c112d95-7d37-4582-be0b-6d8ee4b198cb tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:45.937729 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6cbf709e-ec96-4505-98e2-733f6f1fba0d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:45.938972 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6cbf709e-ec96-4505-98e2-733f6f1fba0d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:45.948457 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2c112d95-7d37-4582-be0b-6d8ee4b198cb tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1313 microversion: 2.1 time: 0.232383 Aug 22 17:32:45.950759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6cbf709e-ec96-4505-98e2-733f6f1fba0d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:45.958570 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 249/506] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:45 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1313 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:45.958815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6cbf709e-ec96-4505-98e2-733f6f1fba0d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:45.958815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6cbf709e-ec96-4505-98e2-733f6f1fba0d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:45.958815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6cbf709e-ec96-4505-98e2-733f6f1fba0d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:45.958815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6cbf709e-ec96-4505-98e2-733f6f1fba0d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:45.959151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6cbf709e-ec96-4505-98e2-733f6f1fba0d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:45.960381 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ec8e4319-0bfd-4843-952b-37008f9f1c8a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:45.961882 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ec8e4319-0bfd-4843-952b-37008f9f1c8a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:45.963373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=100 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:45.975036 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ec8e4319-0bfd-4843-952b-37008f9f1c8a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:45.980453 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ec8e4319-0bfd-4843-952b-37008f9f1c8a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:45.980453 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ec8e4319-0bfd-4843-952b-37008f9f1c8a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:45.980453 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ec8e4319-0bfd-4843-952b-37008f9f1c8a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:45.980453 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ec8e4319-0bfd-4843-952b-37008f9f1c8a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:45.981911 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ec8e4319-0bfd-4843-952b-37008f9f1c8a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:46.033050 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6cbf709e-ec96-4505-98e2-733f6f1fba0d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:46.042019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6cbf709e-ec96-4505-98e2-733f6f1fba0d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1262 microversion: 2.1 time: 0.111848 Aug 22 17:32:46.042883 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 258/507] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:45 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1262 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:46.148758 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ec8e4319-0bfd-4843-952b-37008f9f1c8a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:46.164601 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ec8e4319-0bfd-4843-952b-37008f9f1c8a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.211331 Aug 22 17:32:46.165532 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 250/508] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:45 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:46.970255 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4e7852cc-2074-4814-9eb6-6965ec08912e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:46.971237 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4e7852cc-2074-4814-9eb6-6965ec08912e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:46.974916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-89c0af0e-b430-4207-9a7c-f52093543846 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:46.976051 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-89c0af0e-b430-4207-9a7c-f52093543846 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:46.980272 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e7852cc-2074-4814-9eb6-6965ec08912e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:46.981262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e7852cc-2074-4814-9eb6-6965ec08912e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:46.982337 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e7852cc-2074-4814-9eb6-6965ec08912e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:46.983451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e7852cc-2074-4814-9eb6-6965ec08912e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:46.984030 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e7852cc-2074-4814-9eb6-6965ec08912e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:46.984559 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e7852cc-2074-4814-9eb6-6965ec08912e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:46.985387 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89c0af0e-b430-4207-9a7c-f52093543846 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:46.986319 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89c0af0e-b430-4207-9a7c-f52093543846 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:46.986878 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89c0af0e-b430-4207-9a7c-f52093543846 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:46.991564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89c0af0e-b430-4207-9a7c-f52093543846 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:46.991564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89c0af0e-b430-4207-9a7c-f52093543846 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:46.991564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89c0af0e-b430-4207-9a7c-f52093543846 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:47.168998 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4e7852cc-2074-4814-9eb6-6965ec08912e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:47.183614 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-89c0af0e-b430-4207-9a7c-f52093543846 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:47.187452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4e7852cc-2074-4814-9eb6-6965ec08912e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:47.190180 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4e7852cc-2074-4814-9eb6-6965ec08912e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:47.192278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4e7852cc-2074-4814-9eb6-6965ec08912e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.227397 Aug 22 17:32:47.193289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 259/509] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:46 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:47.197410 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-89c0af0e-b430-4207-9a7c-f52093543846 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1497 microversion: 2.1 time: 0.227228 Aug 22 17:32:47.198329 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 251/510] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:46 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1497 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:47.201573 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3eb68057-c13d-4b94-9d0e-c44b33cfe2db tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:47.202654 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3eb68057-c13d-4b94-9d0e-c44b33cfe2db tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:47.207346 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-287dd9fc-f128-4980-a0e6-199d14d720fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:47.208790 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-287dd9fc-f128-4980-a0e6-199d14d720fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:47.214992 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3eb68057-c13d-4b94-9d0e-c44b33cfe2db tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:47.217212 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3eb68057-c13d-4b94-9d0e-c44b33cfe2db tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:47.218256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3eb68057-c13d-4b94-9d0e-c44b33cfe2db tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:47.219782 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3eb68057-c13d-4b94-9d0e-c44b33cfe2db tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:47.220885 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3eb68057-c13d-4b94-9d0e-c44b33cfe2db tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:47.221361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-287dd9fc-f128-4980-a0e6-199d14d720fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:47.222162 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3eb68057-c13d-4b94-9d0e-c44b33cfe2db tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:47.222813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-287dd9fc-f128-4980-a0e6-199d14d720fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:47.223865 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-287dd9fc-f128-4980-a0e6-199d14d720fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:47.225085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-287dd9fc-f128-4980-a0e6-199d14d720fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:47.225919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-287dd9fc-f128-4980-a0e6-199d14d720fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:47.226679 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-287dd9fc-f128-4980-a0e6-199d14d720fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:47.333173 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3eb68057-c13d-4b94-9d0e-c44b33cfe2db tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:47.343816 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3eb68057-c13d-4b94-9d0e-c44b33cfe2db tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1254 microversion: 2.1 time: 0.148943 Aug 22 17:32:47.345096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 260/511] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:47 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1254 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:47.434871 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-287dd9fc-f128-4980-a0e6-199d14d720fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:47.450981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-287dd9fc-f128-4980-a0e6-199d14d720fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.249890 Aug 22 17:32:47.451893 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 252/512] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:47 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:48.096814 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b6f69743-650b-4bdf-8594-7f2c7cc2b28d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:48.097483 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b6f69743-650b-4bdf-8594-7f2c7cc2b28d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:48.104808 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b6f69743-650b-4bdf-8594-7f2c7cc2b28d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:48.105555 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b6f69743-650b-4bdf-8594-7f2c7cc2b28d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:48.107054 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b6f69743-650b-4bdf-8594-7f2c7cc2b28d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:48.108056 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b6f69743-650b-4bdf-8594-7f2c7cc2b28d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:48.108606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b6f69743-650b-4bdf-8594-7f2c7cc2b28d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:48.113202 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b6f69743-650b-4bdf-8594-7f2c7cc2b28d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:48.140695 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b6f69743-650b-4bdf-8594-7f2c7cc2b28d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Going to try to terminate instance {{(pid=121852) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:32:48.232369 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a0adde9a-627c-4956-ad2f-9c1a8a173827 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:48.233213 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a0adde9a-627c-4956-ad2f-9c1a8a173827 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:48.240378 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0adde9a-627c-4956-ad2f-9c1a8a173827 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:48.240868 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0adde9a-627c-4956-ad2f-9c1a8a173827 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:48.241309 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0adde9a-627c-4956-ad2f-9c1a8a173827 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:48.242022 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0adde9a-627c-4956-ad2f-9c1a8a173827 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:48.242507 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0adde9a-627c-4956-ad2f-9c1a8a173827 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:48.243037 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0adde9a-627c-4956-ad2f-9c1a8a173827 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:48.463142 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a0adde9a-627c-4956-ad2f-9c1a8a173827 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:48.481336 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a0adde9a-627c-4956-ad2f-9c1a8a173827 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:48.484210 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a0adde9a-627c-4956-ad2f-9c1a8a173827 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:48.486810 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a0adde9a-627c-4956-ad2f-9c1a8a173827 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.258453 Aug 22 17:32:48.488374 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 253/513] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:48 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:48.511691 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f95997c0-7a1b-4e15-80fd-b3715c03016d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:48.517364 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f95997c0-7a1b-4e15-80fd-b3715c03016d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:48.557093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f95997c0-7a1b-4e15-80fd-b3715c03016d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:48.558531 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f95997c0-7a1b-4e15-80fd-b3715c03016d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:48.562976 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f95997c0-7a1b-4e15-80fd-b3715c03016d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:48.564730 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f95997c0-7a1b-4e15-80fd-b3715c03016d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:48.567228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f95997c0-7a1b-4e15-80fd-b3715c03016d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:48.573626 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f95997c0-7a1b-4e15-80fd-b3715c03016d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:48.653169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b6f69743-650b-4bdf-8594-7f2c7cc2b28d tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "DELETE /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 204 len: 0 microversion: 2.1 time: 0.559275 Aug 22 17:32:48.655424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 261/514] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:32:48 2022] DELETE /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:32:48.665692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-07d64854-e508-4bf5-a076-896462a2ee8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:48.666661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-07d64854-e508-4bf5-a076-896462a2ee8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:48.669387 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f95997c0-7a1b-4e15-80fd-b3715c03016d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:48.678159 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f95997c0-7a1b-4e15-80fd-b3715c03016d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1254 microversion: 2.1 time: 0.187938 Aug 22 17:32:48.679154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 254/515] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:48 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1254 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:48.679510 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07d64854-e508-4bf5-a076-896462a2ee8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:48.680360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07d64854-e508-4bf5-a076-896462a2ee8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:48.681141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07d64854-e508-4bf5-a076-896462a2ee8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:48.682409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07d64854-e508-4bf5-a076-896462a2ee8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:48.683275 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07d64854-e508-4bf5-a076-896462a2ee8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:48.684161 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-19995ece-0fa1-4abe-99fb-ffb93530639e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:48.685170 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-19995ece-0fa1-4abe-99fb-ffb93530639e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:48.685475 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07d64854-e508-4bf5-a076-896462a2ee8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:48.692684 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-19995ece-0fa1-4abe-99fb-ffb93530639e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:48.694415 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-19995ece-0fa1-4abe-99fb-ffb93530639e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:48.694415 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-19995ece-0fa1-4abe-99fb-ffb93530639e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:48.694415 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-19995ece-0fa1-4abe-99fb-ffb93530639e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:48.694882 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-19995ece-0fa1-4abe-99fb-ffb93530639e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:48.695259 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-19995ece-0fa1-4abe-99fb-ffb93530639e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:48.888368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-07d64854-e508-4bf5-a076-896462a2ee8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:48.898099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-07d64854-e508-4bf5-a076-896462a2ee8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.240878 Aug 22 17:32:48.903157 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 262/516] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:48 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:48.912183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-19995ece-0fa1-4abe-99fb-ffb93530639e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:48.921690 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-19995ece-0fa1-4abe-99fb-ffb93530639e tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1503 microversion: 2.1 time: 0.241445 Aug 22 17:32:48.922521 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 255/517] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:48 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1503 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:49.527288 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-342004f2-9c63-45a9-816e-8817ecbba8cf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:49.528432 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-342004f2-9c63-45a9-816e-8817ecbba8cf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:49.535964 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-342004f2-9c63-45a9-816e-8817ecbba8cf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:49.536518 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-342004f2-9c63-45a9-816e-8817ecbba8cf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:49.537077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-342004f2-9c63-45a9-816e-8817ecbba8cf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:49.537836 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-342004f2-9c63-45a9-816e-8817ecbba8cf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:49.538369 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-342004f2-9c63-45a9-816e-8817ecbba8cf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:49.538886 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-342004f2-9c63-45a9-816e-8817ecbba8cf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:49.684845 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-342004f2-9c63-45a9-816e-8817ecbba8cf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:49.694360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-342004f2-9c63-45a9-816e-8817ecbba8cf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:49.695942 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-342004f2-9c63-45a9-816e-8817ecbba8cf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:49.697748 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-342004f2-9c63-45a9-816e-8817ecbba8cf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.174116 Aug 22 17:32:49.697748 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 263/518] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:49 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:49.704013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-3090109a-fd30-4330-8f4c-083943767b16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:49.704623 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-3090109a-fd30-4330-8f4c-083943767b16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:49.711933 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3090109a-fd30-4330-8f4c-083943767b16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:49.712455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3090109a-fd30-4330-8f4c-083943767b16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:49.712898 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3090109a-fd30-4330-8f4c-083943767b16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:49.713635 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3090109a-fd30-4330-8f4c-083943767b16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:49.714097 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3090109a-fd30-4330-8f4c-083943767b16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:49.714563 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3090109a-fd30-4330-8f4c-083943767b16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:49.784534 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-3090109a-fd30-4330-8f4c-083943767b16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:49.792859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-3090109a-fd30-4330-8f4c-083943767b16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1310 microversion: 2.1 time: 0.092700 Aug 22 17:32:49.794041 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 256/519] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:49 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:49.935310 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5927af3c-1c44-45f7-a2a6-5a305b940dd7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:49.936115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5927af3c-1c44-45f7-a2a6-5a305b940dd7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:49.946210 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5927af3c-1c44-45f7-a2a6-5a305b940dd7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:49.953514 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5927af3c-1c44-45f7-a2a6-5a305b940dd7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:49.953514 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5927af3c-1c44-45f7-a2a6-5a305b940dd7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:49.953514 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5927af3c-1c44-45f7-a2a6-5a305b940dd7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:49.954046 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ef069b09-478d-4c2f-809b-8007e65f8f16 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:49.954196 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5927af3c-1c44-45f7-a2a6-5a305b940dd7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:49.954364 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ef069b09-478d-4c2f-809b-8007e65f8f16 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:49.954543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5927af3c-1c44-45f7-a2a6-5a305b940dd7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:49.960105 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ef069b09-478d-4c2f-809b-8007e65f8f16 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:49.960770 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ef069b09-478d-4c2f-809b-8007e65f8f16 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:49.961297 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ef069b09-478d-4c2f-809b-8007e65f8f16 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:49.962354 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ef069b09-478d-4c2f-809b-8007e65f8f16 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:49.962938 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ef069b09-478d-4c2f-809b-8007e65f8f16 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:49.963501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ef069b09-478d-4c2f-809b-8007e65f8f16 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:50.123609 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ef069b09-478d-4c2f-809b-8007e65f8f16 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:50.132535 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ef069b09-478d-4c2f-809b-8007e65f8f16 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1503 microversion: 2.1 time: 0.188908 Aug 22 17:32:50.133131 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 257/520] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:49 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1503 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:50.169615 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5927af3c-1c44-45f7-a2a6-5a305b940dd7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:50.178672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5927af3c-1c44-45f7-a2a6-5a305b940dd7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.248411 Aug 22 17:32:50.179332 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 264/521] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:49 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:50.742006 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4c3a2007-09b4-4f90-9cc1-5d050a7593b0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:50.743127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4c3a2007-09b4-4f90-9cc1-5d050a7593b0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:50.754045 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4c3a2007-09b4-4f90-9cc1-5d050a7593b0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:50.755332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4c3a2007-09b4-4f90-9cc1-5d050a7593b0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:50.756131 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4c3a2007-09b4-4f90-9cc1-5d050a7593b0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:50.757536 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4c3a2007-09b4-4f90-9cc1-5d050a7593b0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:50.761104 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4c3a2007-09b4-4f90-9cc1-5d050a7593b0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:50.763204 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4c3a2007-09b4-4f90-9cc1-5d050a7593b0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:50.819803 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-eefc8447-9a58-4ba0-a84a-e64aafb7baea tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:50.825583 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-eefc8447-9a58-4ba0-a84a-e64aafb7baea tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:50.840728 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eefc8447-9a58-4ba0-a84a-e64aafb7baea tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:50.842035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eefc8447-9a58-4ba0-a84a-e64aafb7baea tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:50.843025 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eefc8447-9a58-4ba0-a84a-e64aafb7baea tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:50.844741 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eefc8447-9a58-4ba0-a84a-e64aafb7baea tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:50.846315 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eefc8447-9a58-4ba0-a84a-e64aafb7baea tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:50.847386 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eefc8447-9a58-4ba0-a84a-e64aafb7baea tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:50.985592 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-eefc8447-9a58-4ba0-a84a-e64aafb7baea tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:51.002223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-eefc8447-9a58-4ba0-a84a-e64aafb7baea tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1318 microversion: 2.1 time: 0.189783 Aug 22 17:32:51.003832 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 265/522] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:50 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:51.064760 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4c3a2007-09b4-4f90-9cc1-5d050a7593b0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:51.076782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4c3a2007-09b4-4f90-9cc1-5d050a7593b0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:51.079425 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4c3a2007-09b4-4f90-9cc1-5d050a7593b0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:51.081235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4c3a2007-09b4-4f90-9cc1-5d050a7593b0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.347445 Aug 22 17:32:51.082278 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 258/523] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:50 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:51.161530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e490a25f-e512-4706-97f0-128537ff6dfa tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:51.166365 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e490a25f-e512-4706-97f0-128537ff6dfa tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:51.176512 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e490a25f-e512-4706-97f0-128537ff6dfa tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:51.177468 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e490a25f-e512-4706-97f0-128537ff6dfa tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:51.178277 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e490a25f-e512-4706-97f0-128537ff6dfa tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:51.179621 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e490a25f-e512-4706-97f0-128537ff6dfa tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:51.180582 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e490a25f-e512-4706-97f0-128537ff6dfa tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:51.181353 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e490a25f-e512-4706-97f0-128537ff6dfa tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:51.203583 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-93c02ecf-f3ad-42cc-8115-669e640957b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:51.204441 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-93c02ecf-f3ad-42cc-8115-669e640957b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:51.211897 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-93c02ecf-f3ad-42cc-8115-669e640957b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:51.212468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-93c02ecf-f3ad-42cc-8115-669e640957b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:51.213018 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-93c02ecf-f3ad-42cc-8115-669e640957b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:51.213858 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-93c02ecf-f3ad-42cc-8115-669e640957b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:51.214372 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-93c02ecf-f3ad-42cc-8115-669e640957b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:51.215124 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-93c02ecf-f3ad-42cc-8115-669e640957b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:51.562233 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e490a25f-e512-4706-97f0-128537ff6dfa tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:51.584934 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e490a25f-e512-4706-97f0-128537ff6dfa tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1503 microversion: 2.1 time: 0.427276 Aug 22 17:32:51.586341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 266/524] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:51 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1503 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:51.593266 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-93c02ecf-f3ad-42cc-8115-669e640957b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:51.621298 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-93c02ecf-f3ad-42cc-8115-669e640957b2 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.423345 Aug 22 17:32:51.624177 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 259/525] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:51 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:51.677149 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-896274b6-8192-463a-b16c-b7ebc81dec42 req-7dd89789-9231-4bbe-a5c6-9f2a76f8e3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52dc487f-6ba1-4c5a-a5e8-c6f51d640339", "name": "network-vif-deleted", "tag": "9e4c0787-69f9-41b8-8bc8-1ce5965ee3aa"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:32:51.691219 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-896274b6-8192-463a-b16c-b7ebc81dec42 req-7dd89789-9231-4bbe-a5c6-9f2a76f8e3a1 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:51.692036 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-896274b6-8192-463a-b16c-b7ebc81dec42 req-7dd89789-9231-4bbe-a5c6-9f2a76f8e3a1 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:51.692675 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-896274b6-8192-463a-b16c-b7ebc81dec42 req-7dd89789-9231-4bbe-a5c6-9f2a76f8e3a1 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:51.707351 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-896274b6-8192-463a-b16c-b7ebc81dec42 req-7dd89789-9231-4bbe-a5c6-9f2a76f8e3a1 service nova] Creating event network-vif-deleted:9e4c0787-69f9-41b8-8bc8-1ce5965ee3aa for instance 52dc487f-6ba1-4c5a-a5e8-c6f51d640339 on hv-cinder-85394 Aug 22 17:32:51.718474 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-896274b6-8192-463a-b16c-b7ebc81dec42 req-7dd89789-9231-4bbe-a5c6-9f2a76f8e3a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130039 Aug 22 17:32:51.719505 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 267/526] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:32:52.024996 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e6a36170-1012-44ed-8829-ede22a2473ae tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:52.026346 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e6a36170-1012-44ed-8829-ede22a2473ae tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:52.042405 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e6a36170-1012-44ed-8829-ede22a2473ae tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:52.049455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e6a36170-1012-44ed-8829-ede22a2473ae tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:52.050612 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e6a36170-1012-44ed-8829-ede22a2473ae tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:52.051235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e6a36170-1012-44ed-8829-ede22a2473ae tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:52.061148 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e6a36170-1012-44ed-8829-ede22a2473ae tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:52.063747 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e6a36170-1012-44ed-8829-ede22a2473ae tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:52.116529 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a274e1fc-9616-468e-932f-f243daeae1c2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:52.123823 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a274e1fc-9616-468e-932f-f243daeae1c2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:52.179645 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a274e1fc-9616-468e-932f-f243daeae1c2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:52.180602 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a274e1fc-9616-468e-932f-f243daeae1c2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:52.181175 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a274e1fc-9616-468e-932f-f243daeae1c2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:52.182402 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a274e1fc-9616-468e-932f-f243daeae1c2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:52.185592 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a274e1fc-9616-468e-932f-f243daeae1c2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:52.186913 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a274e1fc-9616-468e-932f-f243daeae1c2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:52.480966 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e6a36170-1012-44ed-8829-ede22a2473ae tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:52.499041 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e6a36170-1012-44ed-8829-ede22a2473ae tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.477914 Aug 22 17:32:52.514568 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 260/527] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:52 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:52.549967 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a274e1fc-9616-468e-932f-f243daeae1c2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:52.566891 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a274e1fc-9616-468e-932f-f243daeae1c2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:52.575151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a274e1fc-9616-468e-932f-f243daeae1c2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:52.575151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a274e1fc-9616-468e-932f-f243daeae1c2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.464072 Aug 22 17:32:52.575151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 268/528] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:52 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:52.614056 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-07e0b31f-dfbc-412a-a468-ba80fef51986 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:52.616561 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-07e0b31f-dfbc-412a-a468-ba80fef51986 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:52.631930 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-07e0b31f-dfbc-412a-a468-ba80fef51986 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:52.641674 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-07e0b31f-dfbc-412a-a468-ba80fef51986 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:52.641674 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-07e0b31f-dfbc-412a-a468-ba80fef51986 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:52.641674 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-07e0b31f-dfbc-412a-a468-ba80fef51986 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:52.641674 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-07e0b31f-dfbc-412a-a468-ba80fef51986 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:52.642365 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-07e0b31f-dfbc-412a-a468-ba80fef51986 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:52.660421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-91c18e41-5658-4623-8c5d-60385a0437ef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:52.661581 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-91c18e41-5658-4623-8c5d-60385a0437ef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:52.698933 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-91c18e41-5658-4623-8c5d-60385a0437ef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:52.700225 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-91c18e41-5658-4623-8c5d-60385a0437ef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:52.700972 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-91c18e41-5658-4623-8c5d-60385a0437ef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:52.704941 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-91c18e41-5658-4623-8c5d-60385a0437ef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:52.712978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-91c18e41-5658-4623-8c5d-60385a0437ef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:52.713801 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-91c18e41-5658-4623-8c5d-60385a0437ef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:52.790686 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-07e0b31f-dfbc-412a-a468-ba80fef51986 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:52.808557 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-07e0b31f-dfbc-412a-a468-ba80fef51986 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1298 microversion: 2.1 time: 0.203317 Aug 22 17:32:52.809243 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 261/529] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:52 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1298 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:53.022254 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-91c18e41-5658-4623-8c5d-60385a0437ef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:53.036939 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-91c18e41-5658-4623-8c5d-60385a0437ef tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.383014 Aug 22 17:32:53.037633 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 269/530] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:52 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:53.533603 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-bbb23457-57b2-4f0f-bf31-ad1230244f3c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:53.534728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-bbb23457-57b2-4f0f-bf31-ad1230244f3c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:53.546778 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbb23457-57b2-4f0f-bf31-ad1230244f3c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:53.548129 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbb23457-57b2-4f0f-bf31-ad1230244f3c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:53.549183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbb23457-57b2-4f0f-bf31-ad1230244f3c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:53.550294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbb23457-57b2-4f0f-bf31-ad1230244f3c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:53.551119 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbb23457-57b2-4f0f-bf31-ad1230244f3c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:53.551684 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbb23457-57b2-4f0f-bf31-ad1230244f3c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:53.616717 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-81ce1850-d752-4891-b468-e15cd9fa7ba6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:53.617472 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-81ce1850-d752-4891-b468-e15cd9fa7ba6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:53.624976 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81ce1850-d752-4891-b468-e15cd9fa7ba6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:53.625475 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81ce1850-d752-4891-b468-e15cd9fa7ba6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:53.625905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81ce1850-d752-4891-b468-e15cd9fa7ba6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:53.627021 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81ce1850-d752-4891-b468-e15cd9fa7ba6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:53.627484 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81ce1850-d752-4891-b468-e15cd9fa7ba6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:53.628633 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81ce1850-d752-4891-b468-e15cd9fa7ba6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:53.743243 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-bbb23457-57b2-4f0f-bf31-ad1230244f3c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:53.752378 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-bbb23457-57b2-4f0f-bf31-ad1230244f3c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.223531 Aug 22 17:32:53.752968 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 262/531] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:53 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:53.853533 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-debf4607-8a4b-48b5-9c13-f7264c247bc5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:53.854212 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-debf4607-8a4b-48b5-9c13-f7264c247bc5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:53.861859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-debf4607-8a4b-48b5-9c13-f7264c247bc5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:53.862423 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-debf4607-8a4b-48b5-9c13-f7264c247bc5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:53.862888 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-debf4607-8a4b-48b5-9c13-f7264c247bc5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:53.863612 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-debf4607-8a4b-48b5-9c13-f7264c247bc5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:53.864075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-debf4607-8a4b-48b5-9c13-f7264c247bc5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:53.864501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-debf4607-8a4b-48b5-9c13-f7264c247bc5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:53.865120 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-81ce1850-d752-4891-b468-e15cd9fa7ba6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:53.877743 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-81ce1850-d752-4891-b468-e15cd9fa7ba6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:53.879910 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-81ce1850-d752-4891-b468-e15cd9fa7ba6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:53.881456 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-81ce1850-d752-4891-b468-e15cd9fa7ba6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.268927 Aug 22 17:32:53.882530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 270/532] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:53 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:32:53.890539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=100 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:53.974801 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-debf4607-8a4b-48b5-9c13-f7264c247bc5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:53.990299 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-debf4607-8a4b-48b5-9c13-f7264c247bc5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1298 microversion: 2.1 time: 0.140501 Aug 22 17:32:53.991448 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 263/533] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:53 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1298 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:54.065037 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-bf86b189-a864-4ff2-b6cd-155e485fd135 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:54.066100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-bf86b189-a864-4ff2-b6cd-155e485fd135 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:54.078172 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf86b189-a864-4ff2-b6cd-155e485fd135 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:54.079034 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf86b189-a864-4ff2-b6cd-155e485fd135 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:54.079796 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf86b189-a864-4ff2-b6cd-155e485fd135 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:54.081050 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf86b189-a864-4ff2-b6cd-155e485fd135 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:54.082082 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf86b189-a864-4ff2-b6cd-155e485fd135 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:54.083021 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf86b189-a864-4ff2-b6cd-155e485fd135 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:54.327477 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-bf86b189-a864-4ff2-b6cd-155e485fd135 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:54.343550 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-bf86b189-a864-4ff2-b6cd-155e485fd135 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.286254 Aug 22 17:32:54.347329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 271/534] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:54 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:54.774455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ce0d2d94-c943-4460-a0fd-3306702b9700 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:54.775400 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ce0d2d94-c943-4460-a0fd-3306702b9700 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:54.783391 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce0d2d94-c943-4460-a0fd-3306702b9700 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:54.783991 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce0d2d94-c943-4460-a0fd-3306702b9700 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:54.784312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce0d2d94-c943-4460-a0fd-3306702b9700 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:54.785125 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce0d2d94-c943-4460-a0fd-3306702b9700 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:54.799255 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce0d2d94-c943-4460-a0fd-3306702b9700 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:54.799769 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce0d2d94-c943-4460-a0fd-3306702b9700 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:54.925367 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ee938d67-f430-4f5e-a12c-56207096be97 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:54.926889 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ee938d67-f430-4f5e-a12c-56207096be97 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:54.934999 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ee938d67-f430-4f5e-a12c-56207096be97 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:54.935500 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ee938d67-f430-4f5e-a12c-56207096be97 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:54.935946 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ee938d67-f430-4f5e-a12c-56207096be97 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:54.936892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ee938d67-f430-4f5e-a12c-56207096be97 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:54.937361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ee938d67-f430-4f5e-a12c-56207096be97 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:54.937802 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ee938d67-f430-4f5e-a12c-56207096be97 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:55.023143 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ce0d2d94-c943-4460-a0fd-3306702b9700 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:55.039746 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ce0d2d94-c943-4460-a0fd-3306702b9700 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.268965 Aug 22 17:32:55.054518 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 264/535] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:54 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:55.065176 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d64d574f-a1be-49cb-a33e-0a6f73db5ea1 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:55.065176 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d64d574f-a1be-49cb-a33e-0a6f73db5ea1 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:55.067666 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d64d574f-a1be-49cb-a33e-0a6f73db5ea1 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:55.068173 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d64d574f-a1be-49cb-a33e-0a6f73db5ea1 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:55.068841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d64d574f-a1be-49cb-a33e-0a6f73db5ea1 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:55.069352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d64d574f-a1be-49cb-a33e-0a6f73db5ea1 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:55.069814 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d64d574f-a1be-49cb-a33e-0a6f73db5ea1 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:55.070244 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d64d574f-a1be-49cb-a33e-0a6f73db5ea1 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:55.176419 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d64d574f-a1be-49cb-a33e-0a6f73db5ea1 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:55.191225 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d64d574f-a1be-49cb-a33e-0a6f73db5ea1 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1298 microversion: 2.1 time: 0.135782 Aug 22 17:32:55.202755 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 265/536] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:55 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1298 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:55.221409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ee938d67-f430-4f5e-a12c-56207096be97 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:55.236939 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ee938d67-f430-4f5e-a12c-56207096be97 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:55.240278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ee938d67-f430-4f5e-a12c-56207096be97 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:55.242652 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ee938d67-f430-4f5e-a12c-56207096be97 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.326974 Aug 22 17:32:55.244188 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 272/537] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:54 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:55.383087 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-24b987ef-c955-4b15-9140-26e7238d087a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:55.384325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-24b987ef-c955-4b15-9140-26e7238d087a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:55.396349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-24b987ef-c955-4b15-9140-26e7238d087a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:55.397331 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-24b987ef-c955-4b15-9140-26e7238d087a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:55.398297 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-24b987ef-c955-4b15-9140-26e7238d087a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:55.399887 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-24b987ef-c955-4b15-9140-26e7238d087a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:55.400826 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-24b987ef-c955-4b15-9140-26e7238d087a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:55.401681 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-24b987ef-c955-4b15-9140-26e7238d087a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:55.625065 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-24b987ef-c955-4b15-9140-26e7238d087a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:55.635367 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-24b987ef-c955-4b15-9140-26e7238d087a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.261576 Aug 22 17:32:55.636432 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 266/538] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:55 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:56.080414 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f7fd3f26-b328-4320-85af-5fdc58b99b60 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:56.081593 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f7fd3f26-b328-4320-85af-5fdc58b99b60 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:56.094805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f7fd3f26-b328-4320-85af-5fdc58b99b60 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:56.095794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f7fd3f26-b328-4320-85af-5fdc58b99b60 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:56.096671 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f7fd3f26-b328-4320-85af-5fdc58b99b60 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:56.098052 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f7fd3f26-b328-4320-85af-5fdc58b99b60 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:56.099025 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f7fd3f26-b328-4320-85af-5fdc58b99b60 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:56.099892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f7fd3f26-b328-4320-85af-5fdc58b99b60 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:56.234170 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c2b13720-b56a-4c87-a8d6-b992fd74aa5b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:56.235239 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c2b13720-b56a-4c87-a8d6-b992fd74aa5b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:56.256628 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c2b13720-b56a-4c87-a8d6-b992fd74aa5b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:56.257896 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c2b13720-b56a-4c87-a8d6-b992fd74aa5b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:56.258864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c2b13720-b56a-4c87-a8d6-b992fd74aa5b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:56.260289 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c2b13720-b56a-4c87-a8d6-b992fd74aa5b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:56.261559 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c2b13720-b56a-4c87-a8d6-b992fd74aa5b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:56.263136 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c2b13720-b56a-4c87-a8d6-b992fd74aa5b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:56.338788 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f7fd3f26-b328-4320-85af-5fdc58b99b60 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:56.347974 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:32:56.368856 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f7fd3f26-b328-4320-85af-5fdc58b99b60 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.295134 Aug 22 17:32:56.370196 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 273/539] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:56 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:56.379633 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6b2c733b-32ed-4b23-a170-9630cd8481b8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:56.381448 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6b2c733b-32ed-4b23-a170-9630cd8481b8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:56.391176 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c2b13720-b56a-4c87-a8d6-b992fd74aa5b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:56.392838 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6b2c733b-32ed-4b23-a170-9630cd8481b8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:56.393420 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6b2c733b-32ed-4b23-a170-9630cd8481b8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:56.393941 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6b2c733b-32ed-4b23-a170-9630cd8481b8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:56.394807 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6b2c733b-32ed-4b23-a170-9630cd8481b8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:56.395349 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6b2c733b-32ed-4b23-a170-9630cd8481b8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:56.395864 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6b2c733b-32ed-4b23-a170-9630cd8481b8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:56.406928 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c2b13720-b56a-4c87-a8d6-b992fd74aa5b tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1298 microversion: 2.1 time: 0.180079 Aug 22 17:32:56.408386 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 267/540] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:56 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1298 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:56.655458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6b2c733b-32ed-4b23-a170-9630cd8481b8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:56.659942 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4beafb94-affb-4d6e-9e31-a5d75a14e2ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:56.660655 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4beafb94-affb-4d6e-9e31-a5d75a14e2ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:56.667789 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6b2c733b-32ed-4b23-a170-9630cd8481b8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:56.669238 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4beafb94-affb-4d6e-9e31-a5d75a14e2ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:56.670100 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4beafb94-affb-4d6e-9e31-a5d75a14e2ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:56.670309 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6b2c733b-32ed-4b23-a170-9630cd8481b8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:56.670885 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4beafb94-affb-4d6e-9e31-a5d75a14e2ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:56.671917 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6b2c733b-32ed-4b23-a170-9630cd8481b8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.300490 Aug 22 17:32:56.672129 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4beafb94-affb-4d6e-9e31-a5d75a14e2ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:56.672968 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4beafb94-affb-4d6e-9e31-a5d75a14e2ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:56.673889 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4beafb94-affb-4d6e-9e31-a5d75a14e2ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:56.674951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 274/541] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:56 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:56.957326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4beafb94-affb-4d6e-9e31-a5d75a14e2ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:56.972496 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4beafb94-affb-4d6e-9e31-a5d75a14e2ea tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.316982 Aug 22 17:32:56.973478 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 268/542] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:56 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:57.393791 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ba17faa4-e95e-4fb4-80a6-bc32aa4f092d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:57.394508 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ba17faa4-e95e-4fb4-80a6-bc32aa4f092d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:57.401361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ba17faa4-e95e-4fb4-80a6-bc32aa4f092d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:57.401857 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ba17faa4-e95e-4fb4-80a6-bc32aa4f092d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:57.402731 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ba17faa4-e95e-4fb4-80a6-bc32aa4f092d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:57.403479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ba17faa4-e95e-4fb4-80a6-bc32aa4f092d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:57.403948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ba17faa4-e95e-4fb4-80a6-bc32aa4f092d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:57.404426 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ba17faa4-e95e-4fb4-80a6-bc32aa4f092d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:57.429175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c7777738-0248-480b-a1e4-3471ce1ffeb4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:57.430083 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c7777738-0248-480b-a1e4-3471ce1ffeb4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:57.439056 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7777738-0248-480b-a1e4-3471ce1ffeb4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:57.439949 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7777738-0248-480b-a1e4-3471ce1ffeb4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:57.440934 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7777738-0248-480b-a1e4-3471ce1ffeb4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:57.442063 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7777738-0248-480b-a1e4-3471ce1ffeb4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:57.442940 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7777738-0248-480b-a1e4-3471ce1ffeb4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:57.443733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7777738-0248-480b-a1e4-3471ce1ffeb4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:57.590554 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c7777738-0248-480b-a1e4-3471ce1ffeb4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:57.603622 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c7777738-0248-480b-a1e4-3471ce1ffeb4 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1298 microversion: 2.1 time: 0.178170 Aug 22 17:32:57.604899 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 269/543] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:57 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1298 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:57.652159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ba17faa4-e95e-4fb4-80a6-bc32aa4f092d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:57.665062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ba17faa4-e95e-4fb4-80a6-bc32aa4f092d tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.275374 Aug 22 17:32:57.665841 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 275/544] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:57 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:57.724998 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-43b921cb-af35-4c08-a463-35a8326c9aed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:57.725335 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-43b921cb-af35-4c08-a463-35a8326c9aed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:57.733025 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-43b921cb-af35-4c08-a463-35a8326c9aed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:57.733562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-43b921cb-af35-4c08-a463-35a8326c9aed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:57.734094 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-43b921cb-af35-4c08-a463-35a8326c9aed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:57.734974 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-43b921cb-af35-4c08-a463-35a8326c9aed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:57.735442 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-43b921cb-af35-4c08-a463-35a8326c9aed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:57.735904 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-43b921cb-af35-4c08-a463-35a8326c9aed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:58.014912 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-34695a1d-9e0a-4c53-b3f8-08aefe30e935 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:58.017680 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-34695a1d-9e0a-4c53-b3f8-08aefe30e935 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:58.030658 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34695a1d-9e0a-4c53-b3f8-08aefe30e935 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:58.031997 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34695a1d-9e0a-4c53-b3f8-08aefe30e935 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:58.032802 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34695a1d-9e0a-4c53-b3f8-08aefe30e935 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:58.034122 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34695a1d-9e0a-4c53-b3f8-08aefe30e935 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:58.035000 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34695a1d-9e0a-4c53-b3f8-08aefe30e935 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:58.035797 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34695a1d-9e0a-4c53-b3f8-08aefe30e935 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:58.202698 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-43b921cb-af35-4c08-a463-35a8326c9aed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:58.231039 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-43b921cb-af35-4c08-a463-35a8326c9aed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:58.238472 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-43b921cb-af35-4c08-a463-35a8326c9aed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:58.248506 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-43b921cb-af35-4c08-a463-35a8326c9aed tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.528984 Aug 22 17:32:58.249095 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 270/545] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:57 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:58.310889 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-34695a1d-9e0a-4c53-b3f8-08aefe30e935 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:58.326718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-34695a1d-9e0a-4c53-b3f8-08aefe30e935 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.321493 Aug 22 17:32:58.330235 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 276/546] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:58 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:58.643777 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-71a286bd-a9fb-439e-a6fa-28915cf53e72 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:58.646087 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-71a286bd-a9fb-439e-a6fa-28915cf53e72 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:58.661026 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-71a286bd-a9fb-439e-a6fa-28915cf53e72 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:58.662904 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-71a286bd-a9fb-439e-a6fa-28915cf53e72 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:58.664596 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-71a286bd-a9fb-439e-a6fa-28915cf53e72 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:58.665869 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-71a286bd-a9fb-439e-a6fa-28915cf53e72 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:58.666754 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-71a286bd-a9fb-439e-a6fa-28915cf53e72 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:58.667517 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-71a286bd-a9fb-439e-a6fa-28915cf53e72 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:58.704533 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-718096b8-a30f-4abc-831c-994a0fd63b50 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:58.705596 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-718096b8-a30f-4abc-831c-994a0fd63b50 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:58.717600 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-718096b8-a30f-4abc-831c-994a0fd63b50 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:58.718438 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-718096b8-a30f-4abc-831c-994a0fd63b50 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:58.719182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-718096b8-a30f-4abc-831c-994a0fd63b50 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:58.720379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-718096b8-a30f-4abc-831c-994a0fd63b50 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:58.721133 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-718096b8-a30f-4abc-831c-994a0fd63b50 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:58.722040 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-718096b8-a30f-4abc-831c-994a0fd63b50 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:58.784918 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-71a286bd-a9fb-439e-a6fa-28915cf53e72 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:58.802401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-71a286bd-a9fb-439e-a6fa-28915cf53e72 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1298 microversion: 2.1 time: 0.167408 Aug 22 17:32:58.803928 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 271/547] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:58 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1298 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:59.007145 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-718096b8-a30f-4abc-831c-994a0fd63b50 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:59.026747 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-718096b8-a30f-4abc-831c-994a0fd63b50 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.329612 Aug 22 17:32:59.030733 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 277/548] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:58 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:32:59.301414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-949aa536-3393-4f89-b29f-4ee87ca6140d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:59.302034 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-949aa536-3393-4f89-b29f-4ee87ca6140d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:59.309078 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-949aa536-3393-4f89-b29f-4ee87ca6140d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:59.309635 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-949aa536-3393-4f89-b29f-4ee87ca6140d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:59.310141 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-949aa536-3393-4f89-b29f-4ee87ca6140d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:59.311205 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-949aa536-3393-4f89-b29f-4ee87ca6140d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:59.311715 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-949aa536-3393-4f89-b29f-4ee87ca6140d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:59.312189 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-949aa536-3393-4f89-b29f-4ee87ca6140d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:59.366902 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-cc83c4a0-f04b-4540-aa0c-cb7f1e50c9c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:59.368606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-cc83c4a0-f04b-4540-aa0c-cb7f1e50c9c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:59.380100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cc83c4a0-f04b-4540-aa0c-cb7f1e50c9c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:59.381507 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cc83c4a0-f04b-4540-aa0c-cb7f1e50c9c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:59.382794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cc83c4a0-f04b-4540-aa0c-cb7f1e50c9c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:59.389370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cc83c4a0-f04b-4540-aa0c-cb7f1e50c9c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:59.390804 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cc83c4a0-f04b-4540-aa0c-cb7f1e50c9c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:59.391931 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cc83c4a0-f04b-4540-aa0c-cb7f1e50c9c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:59.539522 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-949aa536-3393-4f89-b29f-4ee87ca6140d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:59.552314 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-949aa536-3393-4f89-b29f-4ee87ca6140d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:59.556638 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-949aa536-3393-4f89-b29f-4ee87ca6140d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:59.561521 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-949aa536-3393-4f89-b29f-4ee87ca6140d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.264235 Aug 22 17:32:59.579858 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 272/549] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:32:59 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:32:59.678890 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-cc83c4a0-f04b-4540-aa0c-cb7f1e50c9c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:59.689530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-cc83c4a0-f04b-4540-aa0c-cb7f1e50c9c6 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.329399 Aug 22 17:32:59.690465 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 278/550] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:59 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:32:59.836396 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-611cb6dd-a6af-49b2-b235-29d2f6cf1995 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:32:59.837482 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-611cb6dd-a6af-49b2-b235-29d2f6cf1995 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:32:59.847768 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-611cb6dd-a6af-49b2-b235-29d2f6cf1995 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:59.848599 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-611cb6dd-a6af-49b2-b235-29d2f6cf1995 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:59.849352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-611cb6dd-a6af-49b2-b235-29d2f6cf1995 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:59.850600 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-611cb6dd-a6af-49b2-b235-29d2f6cf1995 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:32:59.851380 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-611cb6dd-a6af-49b2-b235-29d2f6cf1995 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:32:59.852146 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-611cb6dd-a6af-49b2-b235-29d2f6cf1995 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:32:59.962286 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-611cb6dd-a6af-49b2-b235-29d2f6cf1995 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:32:59.986216 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-611cb6dd-a6af-49b2-b235-29d2f6cf1995 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1298 microversion: 2.1 time: 0.155849 Aug 22 17:32:59.988477 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 273/551] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:32:59 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1298 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:00.054207 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9b760571-61b3-48be-92ab-47561201f938 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:00.056505 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9b760571-61b3-48be-92ab-47561201f938 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:00.068901 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9b760571-61b3-48be-92ab-47561201f938 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:00.069772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9b760571-61b3-48be-92ab-47561201f938 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:00.070629 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9b760571-61b3-48be-92ab-47561201f938 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:00.071981 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9b760571-61b3-48be-92ab-47561201f938 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:00.072971 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9b760571-61b3-48be-92ab-47561201f938 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:00.073968 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9b760571-61b3-48be-92ab-47561201f938 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:00.259388 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9b760571-61b3-48be-92ab-47561201f938 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:00.268449 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9b760571-61b3-48be-92ab-47561201f938 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.220174 Aug 22 17:33:00.269068 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 279/552] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:00 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:00.605102 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a6ff2f53-2481-441d-8730-a509fb643729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:00.606945 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a6ff2f53-2481-441d-8730-a509fb643729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:00.615271 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6ff2f53-2481-441d-8730-a509fb643729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:00.615757 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6ff2f53-2481-441d-8730-a509fb643729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:00.616204 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6ff2f53-2481-441d-8730-a509fb643729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:00.617108 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6ff2f53-2481-441d-8730-a509fb643729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:00.617586 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6ff2f53-2481-441d-8730-a509fb643729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:00.618304 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6ff2f53-2481-441d-8730-a509fb643729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:00.718146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4502baff-b171-4105-8466-70890dd75f8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:00.719319 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4502baff-b171-4105-8466-70890dd75f8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:00.742854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4502baff-b171-4105-8466-70890dd75f8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:00.744754 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4502baff-b171-4105-8466-70890dd75f8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:00.745725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4502baff-b171-4105-8466-70890dd75f8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:00.747704 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4502baff-b171-4105-8466-70890dd75f8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:00.748500 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4502baff-b171-4105-8466-70890dd75f8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:00.749019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4502baff-b171-4105-8466-70890dd75f8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:00.806541 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a6ff2f53-2481-441d-8730-a509fb643729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:00.837763 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a6ff2f53-2481-441d-8730-a509fb643729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:00.842588 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a6ff2f53-2481-441d-8730-a509fb643729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:00.844780 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a6ff2f53-2481-441d-8730-a509fb643729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.244481 Aug 22 17:33:00.845832 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 274/553] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:00 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:33:01.016831 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4ff6d72e-98ea-490c-9494-e64074ff6a01 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:01.017046 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4502baff-b171-4105-8466-70890dd75f8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:01.018079 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4ff6d72e-98ea-490c-9494-e64074ff6a01 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:01.036091 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4502baff-b171-4105-8466-70890dd75f8d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.319815 Aug 22 17:33:01.047841 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 280/554] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:00 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:01.048166 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4ff6d72e-98ea-490c-9494-e64074ff6a01 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:01.048166 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4ff6d72e-98ea-490c-9494-e64074ff6a01 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:01.048166 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4ff6d72e-98ea-490c-9494-e64074ff6a01 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:01.048166 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4ff6d72e-98ea-490c-9494-e64074ff6a01 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:01.063298 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4ff6d72e-98ea-490c-9494-e64074ff6a01 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:01.064634 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4ff6d72e-98ea-490c-9494-e64074ff6a01 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:01.227182 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4ff6d72e-98ea-490c-9494-e64074ff6a01 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:01.227182 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4ff6d72e-98ea-490c-9494-e64074ff6a01 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1298 microversion: 2.1 time: 0.200959 Aug 22 17:33:01.227182 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 275/555] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:01 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1298 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:01.290213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b9bdab12-9692-427f-9dcb-f31640121ff1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:01.291775 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b9bdab12-9692-427f-9dcb-f31640121ff1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:01.309547 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b9bdab12-9692-427f-9dcb-f31640121ff1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:01.310453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b9bdab12-9692-427f-9dcb-f31640121ff1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:01.311182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b9bdab12-9692-427f-9dcb-f31640121ff1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:01.312306 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b9bdab12-9692-427f-9dcb-f31640121ff1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:01.313061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b9bdab12-9692-427f-9dcb-f31640121ff1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:01.313743 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b9bdab12-9692-427f-9dcb-f31640121ff1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:01.549937 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b9bdab12-9692-427f-9dcb-f31640121ff1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:01.560702 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b9bdab12-9692-427f-9dcb-f31640121ff1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.274728 Aug 22 17:33:01.565652 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 281/556] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:01 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:01.894665 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a2106587-29c7-4bbc-8c83-3391b1ecc415 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:01.895338 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a2106587-29c7-4bbc-8c83-3391b1ecc415 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:01.905037 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a2106587-29c7-4bbc-8c83-3391b1ecc415 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:01.905672 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a2106587-29c7-4bbc-8c83-3391b1ecc415 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:01.906169 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a2106587-29c7-4bbc-8c83-3391b1ecc415 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:01.907048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a2106587-29c7-4bbc-8c83-3391b1ecc415 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:01.907559 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a2106587-29c7-4bbc-8c83-3391b1ecc415 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:01.908083 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a2106587-29c7-4bbc-8c83-3391b1ecc415 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:02.050276 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a2106587-29c7-4bbc-8c83-3391b1ecc415 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:02.060133 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a2106587-29c7-4bbc-8c83-3391b1ecc415 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:02.061917 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a2106587-29c7-4bbc-8c83-3391b1ecc415 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:02.063908 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a2106587-29c7-4bbc-8c83-3391b1ecc415 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.173446 Aug 22 17:33:02.076547 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 276/557] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:01 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:33:02.086418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-dd82ed82-2f8d-49be-b578-c22cd9096698 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:02.087639 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-dd82ed82-2f8d-49be-b578-c22cd9096698 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:02.097588 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-dd82ed82-2f8d-49be-b578-c22cd9096698 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:02.098296 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-dd82ed82-2f8d-49be-b578-c22cd9096698 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:02.098841 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-dd82ed82-2f8d-49be-b578-c22cd9096698 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:02.099862 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-dd82ed82-2f8d-49be-b578-c22cd9096698 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:02.100644 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-dd82ed82-2f8d-49be-b578-c22cd9096698 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:02.101390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-dd82ed82-2f8d-49be-b578-c22cd9096698 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:02.255860 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8b9b1423-f610-403a-b5f4-5590dc9b1339 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:02.256479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8b9b1423-f610-403a-b5f4-5590dc9b1339 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:02.262865 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8b9b1423-f610-403a-b5f4-5590dc9b1339 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:02.263355 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8b9b1423-f610-403a-b5f4-5590dc9b1339 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:02.263786 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8b9b1423-f610-403a-b5f4-5590dc9b1339 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:02.264481 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8b9b1423-f610-403a-b5f4-5590dc9b1339 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:02.264933 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8b9b1423-f610-403a-b5f4-5590dc9b1339 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:02.265356 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8b9b1423-f610-403a-b5f4-5590dc9b1339 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:02.329154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8b9b1423-f610-403a-b5f4-5590dc9b1339 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:02.337196 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8b9b1423-f610-403a-b5f4-5590dc9b1339 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1298 microversion: 2.1 time: 0.085126 Aug 22 17:33:02.337777 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 277/558] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:02 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:02.342674 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-dd82ed82-2f8d-49be-b578-c22cd9096698 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:02.352646 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-dd82ed82-2f8d-49be-b578-c22cd9096698 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.273899 Aug 22 17:33:02.353231 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 282/559] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:02 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:02.595043 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0fa0a78c-e876-431d-9713-b76d9e623a9b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:02.596154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0fa0a78c-e876-431d-9713-b76d9e623a9b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:02.605821 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0fa0a78c-e876-431d-9713-b76d9e623a9b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:02.606781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0fa0a78c-e876-431d-9713-b76d9e623a9b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:02.607554 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0fa0a78c-e876-431d-9713-b76d9e623a9b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:02.608816 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0fa0a78c-e876-431d-9713-b76d9e623a9b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:02.609642 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0fa0a78c-e876-431d-9713-b76d9e623a9b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:02.610383 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0fa0a78c-e876-431d-9713-b76d9e623a9b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:02.782626 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0fa0a78c-e876-431d-9713-b76d9e623a9b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:02.791474 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0fa0a78c-e876-431d-9713-b76d9e623a9b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.204527 Aug 22 17:33:02.792079 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 278/560] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:02 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:03.102909 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f0e87b86-9cc6-4065-9c53-203e299aeb50 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:03.103725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f0e87b86-9cc6-4065-9c53-203e299aeb50 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:03.111661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0e87b86-9cc6-4065-9c53-203e299aeb50 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:03.112332 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0e87b86-9cc6-4065-9c53-203e299aeb50 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:03.112855 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0e87b86-9cc6-4065-9c53-203e299aeb50 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:03.113647 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0e87b86-9cc6-4065-9c53-203e299aeb50 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:03.114165 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0e87b86-9cc6-4065-9c53-203e299aeb50 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:03.114739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0e87b86-9cc6-4065-9c53-203e299aeb50 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:03.313004 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-8959b0e0-5950-4301-9daa-88be1d47d793 req-8c0d89b9-b089-4f3b-a124-c7147cbb6983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ff94bc-e986-4201-96e7-484c08490011", "tag": "a4e21f10-9c29-4641-93d3-684817ef690e"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:03.324664 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-8959b0e0-5950-4301-9daa-88be1d47d793 req-8c0d89b9-b089-4f3b-a124-c7147cbb6983 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:03.325153 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-8959b0e0-5950-4301-9daa-88be1d47d793 req-8c0d89b9-b089-4f3b-a124-c7147cbb6983 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:03.325936 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-8959b0e0-5950-4301-9daa-88be1d47d793 req-8c0d89b9-b089-4f3b-a124-c7147cbb6983 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:03.338434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-8959b0e0-5950-4301-9daa-88be1d47d793 req-8c0d89b9-b089-4f3b-a124-c7147cbb6983 service nova] Creating event network-changed:a4e21f10-9c29-4641-93d3-684817ef690e for instance 84ff94bc-e986-4201-96e7-484c08490011 on hv-cinder-85394 Aug 22 17:33:03.345433 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-8959b0e0-5950-4301-9daa-88be1d47d793 req-8c0d89b9-b089-4f3b-a124-c7147cbb6983 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038273 Aug 22 17:33:03.346342 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 279/561] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:33:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:33:03.361299 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-931c9b8c-927c-4e97-a606-7968bd5973d0 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:03.362014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-931c9b8c-927c-4e97-a606-7968bd5973d0 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:03.369019 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-931c9b8c-927c-4e97-a606-7968bd5973d0 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:03.369807 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-931c9b8c-927c-4e97-a606-7968bd5973d0 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:03.370155 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-931c9b8c-927c-4e97-a606-7968bd5973d0 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:03.371611 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-931c9b8c-927c-4e97-a606-7968bd5973d0 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:03.372049 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-931c9b8c-927c-4e97-a606-7968bd5973d0 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:03.372475 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-931c9b8c-927c-4e97-a606-7968bd5973d0 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:03.396898 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f0e87b86-9cc6-4065-9c53-203e299aeb50 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:03.411162 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-931c9b8c-927c-4e97-a606-7968bd5973d0 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:03.411652 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-931c9b8c-927c-4e97-a606-7968bd5973d0 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:03.412094 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-931c9b8c-927c-4e97-a606-7968bd5973d0 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:03.412547 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-931c9b8c-927c-4e97-a606-7968bd5973d0 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lazy-loading 'fault' on Instance uuid 52dc487f-6ba1-4c5a-a5e8-c6f51d640339 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:33:03.414081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f0e87b86-9cc6-4065-9c53-203e299aeb50 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:03.416182 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=100 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:03.417465 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f0e87b86-9cc6-4065-9c53-203e299aeb50 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:03.421838 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f0e87b86-9cc6-4065-9c53-203e299aeb50 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.323398 Aug 22 17:33:03.422773 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 283/562] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:03 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:33:03.431444 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-1e3be83f-2e51-442b-bc87-aca9a286bb3a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:03.432607 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-1e3be83f-2e51-442b-bc87-aca9a286bb3a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:03.445199 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1e3be83f-2e51-442b-bc87-aca9a286bb3a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:03.451087 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1e3be83f-2e51-442b-bc87-aca9a286bb3a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:03.451087 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1e3be83f-2e51-442b-bc87-aca9a286bb3a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:03.451087 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1e3be83f-2e51-442b-bc87-aca9a286bb3a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:03.451087 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1e3be83f-2e51-442b-bc87-aca9a286bb3a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:03.451532 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1e3be83f-2e51-442b-bc87-aca9a286bb3a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:03.483000 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-931c9b8c-927c-4e97-a606-7968bd5973d0 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:03.491420 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-931c9b8c-927c-4e97-a606-7968bd5973d0 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1303 microversion: 2.1 time: 0.135726 Aug 22 17:33:03.492009 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 280/563] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:03 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:03.613893 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-1e3be83f-2e51-442b-bc87-aca9a286bb3a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:03.623830 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-1e3be83f-2e51-442b-bc87-aca9a286bb3a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.199632 Aug 22 17:33:03.624444 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 284/564] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:03 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:03.828212 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e12f2967-dfa9-4780-ac85-8b198a03e54f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:03.828866 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e12f2967-dfa9-4780-ac85-8b198a03e54f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:03.836305 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e12f2967-dfa9-4780-ac85-8b198a03e54f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:03.836810 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e12f2967-dfa9-4780-ac85-8b198a03e54f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:03.837252 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e12f2967-dfa9-4780-ac85-8b198a03e54f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:03.838003 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e12f2967-dfa9-4780-ac85-8b198a03e54f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:03.838698 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e12f2967-dfa9-4780-ac85-8b198a03e54f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:03.838990 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e12f2967-dfa9-4780-ac85-8b198a03e54f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:03.991482 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e12f2967-dfa9-4780-ac85-8b198a03e54f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:04.000377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e12f2967-dfa9-4780-ac85-8b198a03e54f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.176111 Aug 22 17:33:04.000983 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 281/565] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:03 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:04.469294 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a51e6579-0a23-401e-9c9e-87a8b07951bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:04.470370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a51e6579-0a23-401e-9c9e-87a8b07951bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:04.483574 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a51e6579-0a23-401e-9c9e-87a8b07951bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:04.484444 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a51e6579-0a23-401e-9c9e-87a8b07951bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:04.489064 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a51e6579-0a23-401e-9c9e-87a8b07951bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:04.489064 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a51e6579-0a23-401e-9c9e-87a8b07951bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:04.489064 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a51e6579-0a23-401e-9c9e-87a8b07951bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:04.489064 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a51e6579-0a23-401e-9c9e-87a8b07951bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:04.520836 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a0376d2c-5737-4feb-bdde-8a5073035607 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:04.521815 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a0376d2c-5737-4feb-bdde-8a5073035607 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:04.530702 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0376d2c-5737-4feb-bdde-8a5073035607 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:04.531566 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0376d2c-5737-4feb-bdde-8a5073035607 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:04.532334 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0376d2c-5737-4feb-bdde-8a5073035607 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:04.533572 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0376d2c-5737-4feb-bdde-8a5073035607 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:04.534378 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0376d2c-5737-4feb-bdde-8a5073035607 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:04.535193 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0376d2c-5737-4feb-bdde-8a5073035607 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:04.581196 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0376d2c-5737-4feb-bdde-8a5073035607 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:04.582060 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0376d2c-5737-4feb-bdde-8a5073035607 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:04.582895 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0376d2c-5737-4feb-bdde-8a5073035607 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:04.583749 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-a0376d2c-5737-4feb-bdde-8a5073035607 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lazy-loading 'fault' on Instance uuid 52dc487f-6ba1-4c5a-a5e8-c6f51d640339 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:33:04.648731 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a0376d2c-5737-4feb-bdde-8a5073035607 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:04.658987 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a0376d2c-5737-4feb-bdde-8a5073035607 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1303 microversion: 2.1 time: 0.142429 Aug 22 17:33:04.660944 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 282/566] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:04 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1303 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:04.669199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2a35b266-42bf-45ba-93c6-12092acd9f86 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:04.669961 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2a35b266-42bf-45ba-93c6-12092acd9f86 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:04.678136 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2a35b266-42bf-45ba-93c6-12092acd9f86 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:04.678767 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2a35b266-42bf-45ba-93c6-12092acd9f86 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:04.679464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2a35b266-42bf-45ba-93c6-12092acd9f86 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:04.680290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2a35b266-42bf-45ba-93c6-12092acd9f86 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:04.680836 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2a35b266-42bf-45ba-93c6-12092acd9f86 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:04.681352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2a35b266-42bf-45ba-93c6-12092acd9f86 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:04.687063 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a51e6579-0a23-401e-9c9e-87a8b07951bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:04.705198 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a51e6579-0a23-401e-9c9e-87a8b07951bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:04.708892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a51e6579-0a23-401e-9c9e-87a8b07951bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:04.711294 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a51e6579-0a23-401e-9c9e-87a8b07951bd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.250543 Aug 22 17:33:04.712720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 285/567] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:04 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:33:04.859161 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2a35b266-42bf-45ba-93c6-12092acd9f86 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:04.868314 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2a35b266-42bf-45ba-93c6-12092acd9f86 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.207648 Aug 22 17:33:04.869272 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 283/568] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:04 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:05.022927 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-83e8bc34-f0bf-45b9-b3de-625ab39c6217 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:05.023551 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-83e8bc34-f0bf-45b9-b3de-625ab39c6217 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:05.031035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83e8bc34-f0bf-45b9-b3de-625ab39c6217 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:05.031560 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83e8bc34-f0bf-45b9-b3de-625ab39c6217 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:05.031978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83e8bc34-f0bf-45b9-b3de-625ab39c6217 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:05.032705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83e8bc34-f0bf-45b9-b3de-625ab39c6217 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:05.033167 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83e8bc34-f0bf-45b9-b3de-625ab39c6217 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:05.033660 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83e8bc34-f0bf-45b9-b3de-625ab39c6217 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:05.212999 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-83e8bc34-f0bf-45b9-b3de-625ab39c6217 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:05.222191 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-83e8bc34-f0bf-45b9-b3de-625ab39c6217 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.203176 Aug 22 17:33:05.222846 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 286/569] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:05 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:05.690587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-457abc2b-31bd-40eb-b0f8-2d53b5bf16a5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:05.691303 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-457abc2b-31bd-40eb-b0f8-2d53b5bf16a5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:05.698813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-457abc2b-31bd-40eb-b0f8-2d53b5bf16a5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:05.700105 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-457abc2b-31bd-40eb-b0f8-2d53b5bf16a5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:05.700953 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-457abc2b-31bd-40eb-b0f8-2d53b5bf16a5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:05.701686 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-457abc2b-31bd-40eb-b0f8-2d53b5bf16a5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:05.702205 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-457abc2b-31bd-40eb-b0f8-2d53b5bf16a5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:05.702692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-457abc2b-31bd-40eb-b0f8-2d53b5bf16a5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:05.738138 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-457abc2b-31bd-40eb-b0f8-2d53b5bf16a5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:05.738674 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-457abc2b-31bd-40eb-b0f8-2d53b5bf16a5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:05.739125 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-457abc2b-31bd-40eb-b0f8-2d53b5bf16a5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:05.739699 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-457abc2b-31bd-40eb-b0f8-2d53b5bf16a5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lazy-loading 'fault' on Instance uuid 52dc487f-6ba1-4c5a-a5e8-c6f51d640339 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:33:05.748558 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c235c231-02b5-40d3-bb92-9909c2a4f764 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:05.750940 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c235c231-02b5-40d3-bb92-9909c2a4f764 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:05.761821 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c235c231-02b5-40d3-bb92-9909c2a4f764 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:05.762460 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c235c231-02b5-40d3-bb92-9909c2a4f764 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:05.763119 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c235c231-02b5-40d3-bb92-9909c2a4f764 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:05.764056 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c235c231-02b5-40d3-bb92-9909c2a4f764 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:05.764626 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c235c231-02b5-40d3-bb92-9909c2a4f764 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:05.765161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c235c231-02b5-40d3-bb92-9909c2a4f764 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:05.794983 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-457abc2b-31bd-40eb-b0f8-2d53b5bf16a5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:05.807750 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-457abc2b-31bd-40eb-b0f8-2d53b5bf16a5 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1303 microversion: 2.1 time: 0.120696 Aug 22 17:33:05.809271 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 284/570] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:05 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:05.890703 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b114c53c-9893-4636-a84a-f57f20d34b6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:05.891427 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b114c53c-9893-4636-a84a-f57f20d34b6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:05.898921 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b114c53c-9893-4636-a84a-f57f20d34b6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:05.899593 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b114c53c-9893-4636-a84a-f57f20d34b6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:05.900178 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b114c53c-9893-4636-a84a-f57f20d34b6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:05.901044 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b114c53c-9893-4636-a84a-f57f20d34b6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:05.901755 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b114c53c-9893-4636-a84a-f57f20d34b6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:05.903311 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b114c53c-9893-4636-a84a-f57f20d34b6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:05.941560 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c235c231-02b5-40d3-bb92-9909c2a4f764 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:05.959583 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c235c231-02b5-40d3-bb92-9909c2a4f764 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:05.962671 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c235c231-02b5-40d3-bb92-9909c2a4f764 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:05.966438 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c235c231-02b5-40d3-bb92-9909c2a4f764 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.228953 Aug 22 17:33:05.967542 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 287/571] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:05 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:33:06.066580 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b114c53c-9893-4636-a84a-f57f20d34b6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:06.076062 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b114c53c-9893-4636-a84a-f57f20d34b6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.190421 Aug 22 17:33:06.076664 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 285/572] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:05 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:06.253560 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4e108ac8-7617-402a-86ee-758c7de55ff7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:06.254182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4e108ac8-7617-402a-86ee-758c7de55ff7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:06.261827 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e108ac8-7617-402a-86ee-758c7de55ff7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:06.262287 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e108ac8-7617-402a-86ee-758c7de55ff7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:06.262753 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e108ac8-7617-402a-86ee-758c7de55ff7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:06.263471 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e108ac8-7617-402a-86ee-758c7de55ff7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:06.263924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e108ac8-7617-402a-86ee-758c7de55ff7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:06.264346 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e108ac8-7617-402a-86ee-758c7de55ff7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:06.409007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4e108ac8-7617-402a-86ee-758c7de55ff7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:06.419225 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4e108ac8-7617-402a-86ee-758c7de55ff7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.168965 Aug 22 17:33:06.419957 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 288/573] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:06 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:06.842101 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-94792c5c-92bd-4c62-8da6-38051dbb9eca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:06.842915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-94792c5c-92bd-4c62-8da6-38051dbb9eca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:06.850201 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-94792c5c-92bd-4c62-8da6-38051dbb9eca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:06.850810 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-94792c5c-92bd-4c62-8da6-38051dbb9eca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:06.851261 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-94792c5c-92bd-4c62-8da6-38051dbb9eca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:06.852012 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-94792c5c-92bd-4c62-8da6-38051dbb9eca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:06.852464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-94792c5c-92bd-4c62-8da6-38051dbb9eca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:06.852893 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-94792c5c-92bd-4c62-8da6-38051dbb9eca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:06.892015 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-94792c5c-92bd-4c62-8da6-38051dbb9eca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:06.892499 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-94792c5c-92bd-4c62-8da6-38051dbb9eca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:06.893011 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-94792c5c-92bd-4c62-8da6-38051dbb9eca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:06.893465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-94792c5c-92bd-4c62-8da6-38051dbb9eca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lazy-loading 'fault' on Instance uuid 52dc487f-6ba1-4c5a-a5e8-c6f51d640339 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:33:06.959717 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-94792c5c-92bd-4c62-8da6-38051dbb9eca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:06.970668 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-94792c5c-92bd-4c62-8da6-38051dbb9eca tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1303 microversion: 2.1 time: 0.133394 Aug 22 17:33:06.972000 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 286/574] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:06 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1303 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:06.996628 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ffbbcfec-9257-4376-b0ac-cbf71d4bf496 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:06.998408 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ffbbcfec-9257-4376-b0ac-cbf71d4bf496 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:07.002536 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=100 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:07.006808 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ffbbcfec-9257-4376-b0ac-cbf71d4bf496 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:07.007251 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ffbbcfec-9257-4376-b0ac-cbf71d4bf496 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:07.007704 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ffbbcfec-9257-4376-b0ac-cbf71d4bf496 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:07.008637 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ffbbcfec-9257-4376-b0ac-cbf71d4bf496 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:07.009063 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ffbbcfec-9257-4376-b0ac-cbf71d4bf496 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:07.009609 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ffbbcfec-9257-4376-b0ac-cbf71d4bf496 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:07.088888 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-9673adcf-3dc8-41be-ba1e-339ac8e452c4 req-b8f372a2-081b-4486-8ddc-fa07be53cdf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb3959b-fd48-4a97-81d0-5b74ec4cfd32", "name": "network-vif-plugged", "status": "completed", "tag": "703038a4-7ff6-4222-b6d6-2865ce69bda5"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:07.117634 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9673adcf-3dc8-41be-ba1e-339ac8e452c4 req-b8f372a2-081b-4486-8ddc-fa07be53cdf8 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:07.123567 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9673adcf-3dc8-41be-ba1e-339ac8e452c4 req-b8f372a2-081b-4486-8ddc-fa07be53cdf8 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:07.123567 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9673adcf-3dc8-41be-ba1e-339ac8e452c4 req-b8f372a2-081b-4486-8ddc-fa07be53cdf8 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:07.143317 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-9673adcf-3dc8-41be-ba1e-339ac8e452c4 req-b8f372a2-081b-4486-8ddc-fa07be53cdf8 service nova] Creating event network-vif-plugged:703038a4-7ff6-4222-b6d6-2865ce69bda5 for instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 on hv-cinder-85394 Aug 22 17:33:07.151331 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-9673adcf-3dc8-41be-ba1e-339ac8e452c4 req-b8f372a2-081b-4486-8ddc-fa07be53cdf8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164436 Aug 22 17:33:07.153054 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 289/575] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:33:07.160723 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b5fa3b02-4306-4041-992e-f94c1a3cd316 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:07.161925 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b5fa3b02-4306-4041-992e-f94c1a3cd316 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:07.173914 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b5fa3b02-4306-4041-992e-f94c1a3cd316 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:07.176224 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b5fa3b02-4306-4041-992e-f94c1a3cd316 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:07.177039 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b5fa3b02-4306-4041-992e-f94c1a3cd316 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:07.178411 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b5fa3b02-4306-4041-992e-f94c1a3cd316 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:07.179581 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b5fa3b02-4306-4041-992e-f94c1a3cd316 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:07.180415 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b5fa3b02-4306-4041-992e-f94c1a3cd316 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:07.227868 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ffbbcfec-9257-4376-b0ac-cbf71d4bf496 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:07.240090 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ffbbcfec-9257-4376-b0ac-cbf71d4bf496 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:07.246590 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ffbbcfec-9257-4376-b0ac-cbf71d4bf496 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:07.246590 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ffbbcfec-9257-4376-b0ac-cbf71d4bf496 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.251493 Aug 22 17:33:07.246590 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 287/576] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:06 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:33:07.349024 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b5fa3b02-4306-4041-992e-f94c1a3cd316 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:07.358435 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b5fa3b02-4306-4041-992e-f94c1a3cd316 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.204052 Aug 22 17:33:07.359072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 290/577] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:07 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:07.441030 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-029c09b1-c7ee-49e7-96da-129aea0c1cb2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:07.441647 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-029c09b1-c7ee-49e7-96da-129aea0c1cb2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:07.448119 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-029c09b1-c7ee-49e7-96da-129aea0c1cb2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:07.448605 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-029c09b1-c7ee-49e7-96da-129aea0c1cb2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:07.449699 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-029c09b1-c7ee-49e7-96da-129aea0c1cb2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:07.450410 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-029c09b1-c7ee-49e7-96da-129aea0c1cb2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:07.450895 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-029c09b1-c7ee-49e7-96da-129aea0c1cb2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:07.451313 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-029c09b1-c7ee-49e7-96da-129aea0c1cb2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:07.604263 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-029c09b1-c7ee-49e7-96da-129aea0c1cb2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:07.614609 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-029c09b1-c7ee-49e7-96da-129aea0c1cb2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.177436 Aug 22 17:33:07.615266 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 288/578] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:07 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:07.993836 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-565f0c71-2c42-41e1-b6d3-afdd4b1fe918 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:07.994540 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-565f0c71-2c42-41e1-b6d3-afdd4b1fe918 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:08.002760 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-565f0c71-2c42-41e1-b6d3-afdd4b1fe918 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:08.003444 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-565f0c71-2c42-41e1-b6d3-afdd4b1fe918 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:08.003985 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-565f0c71-2c42-41e1-b6d3-afdd4b1fe918 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:08.004828 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-565f0c71-2c42-41e1-b6d3-afdd4b1fe918 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:08.005473 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-565f0c71-2c42-41e1-b6d3-afdd4b1fe918 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:08.006006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-565f0c71-2c42-41e1-b6d3-afdd4b1fe918 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:08.012904 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=100 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:08.046887 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-565f0c71-2c42-41e1-b6d3-afdd4b1fe918 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:08.047423 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-565f0c71-2c42-41e1-b6d3-afdd4b1fe918 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:08.047895 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-565f0c71-2c42-41e1-b6d3-afdd4b1fe918 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:08.048383 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-565f0c71-2c42-41e1-b6d3-afdd4b1fe918 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lazy-loading 'fault' on Instance uuid 52dc487f-6ba1-4c5a-a5e8-c6f51d640339 {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:33:08.092871 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-565f0c71-2c42-41e1-b6d3-afdd4b1fe918 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2351ea9262c44d74827e79231d1813c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7508a86facdb4ff98b171aa75962dde5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:08.101537 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-565f0c71-2c42-41e1-b6d3-afdd4b1fe918 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 200 len: 1303 microversion: 2.1 time: 0.111542 Aug 22 17:33:08.102131 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 291/579] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:07 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:08.269042 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-fa2af9a0-3116-4996-941f-c83e013ed729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:08.269622 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-fa2af9a0-3116-4996-941f-c83e013ed729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:08.277392 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fa2af9a0-3116-4996-941f-c83e013ed729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:08.278163 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fa2af9a0-3116-4996-941f-c83e013ed729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:08.278459 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fa2af9a0-3116-4996-941f-c83e013ed729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:08.279278 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fa2af9a0-3116-4996-941f-c83e013ed729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:08.279781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fa2af9a0-3116-4996-941f-c83e013ed729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:08.280305 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fa2af9a0-3116-4996-941f-c83e013ed729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:08.380638 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-bc380508-108b-4edd-a89f-dd52f0579aa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:08.381260 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-bc380508-108b-4edd-a89f-dd52f0579aa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:08.390794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bc380508-108b-4edd-a89f-dd52f0579aa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:08.391289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bc380508-108b-4edd-a89f-dd52f0579aa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:08.391826 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bc380508-108b-4edd-a89f-dd52f0579aa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:08.392599 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bc380508-108b-4edd-a89f-dd52f0579aa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:08.393054 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bc380508-108b-4edd-a89f-dd52f0579aa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:08.393474 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bc380508-108b-4edd-a89f-dd52f0579aa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:08.437822 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-fa2af9a0-3116-4996-941f-c83e013ed729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:08.447615 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-fa2af9a0-3116-4996-941f-c83e013ed729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:08.450351 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-fa2af9a0-3116-4996-941f-c83e013ed729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:08.451644 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-fa2af9a0-3116-4996-941f-c83e013ed729 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.187024 Aug 22 17:33:08.452209 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 289/580] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:08 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:33:08.592780 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-bc380508-108b-4edd-a89f-dd52f0579aa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:08.601697 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-bc380508-108b-4edd-a89f-dd52f0579aa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.224910 Aug 22 17:33:08.602305 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 292/581] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:08 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:08.639059 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-efdf7321-5995-4742-b3db-866c1779fcd0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:08.639723 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-efdf7321-5995-4742-b3db-866c1779fcd0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:08.646564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efdf7321-5995-4742-b3db-866c1779fcd0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:08.647121 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efdf7321-5995-4742-b3db-866c1779fcd0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:08.647594 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efdf7321-5995-4742-b3db-866c1779fcd0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:08.648372 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efdf7321-5995-4742-b3db-866c1779fcd0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:08.648862 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efdf7321-5995-4742-b3db-866c1779fcd0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:08.649321 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efdf7321-5995-4742-b3db-866c1779fcd0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:08.811884 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-efdf7321-5995-4742-b3db-866c1779fcd0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:08.822033 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-efdf7321-5995-4742-b3db-866c1779fcd0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.188264 Aug 22 17:33:08.822763 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 290/582] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:08 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:09.124707 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6868cb2f-22f6-4de7-9b93-54af368150b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:09.125475 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6868cb2f-22f6-4de7-9b93-54af368150b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] [instance: 52dc487f-6ba1-4c5a-a5e8-c6f51d640339] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:09.133202 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6868cb2f-22f6-4de7-9b93-54af368150b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:09.133753 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6868cb2f-22f6-4de7-9b93-54af368150b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:09.134236 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6868cb2f-22f6-4de7-9b93-54af368150b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:09.135096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6868cb2f-22f6-4de7-9b93-54af368150b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:09.136009 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6868cb2f-22f6-4de7-9b93-54af368150b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:09.137106 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6868cb2f-22f6-4de7-9b93-54af368150b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:09.154147 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-6868cb2f-22f6-4de7-9b93-54af368150b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] HTTP exception thrown: Instance 52dc487f-6ba1-4c5a-a5e8-c6f51d640339 could not be found. Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6868cb2f-22f6-4de7-9b93-54af368150b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Request method failure captured: Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 HTTP/1.1 Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA716LLhjm8gYSSqj_4RWRZ61OOeFr15nkUG8zL42MpJe-LADantwLfqF7r-XKH9YBKll9jyslvF14GJSa33vcy_5flJTR6jj16wNr7qd-97xvRg77IjzdQJkzd5vGkEXINJHoZBTAatq49KWx_9hQbcqbRXhG7zIwmmWA0sAXcW3BLw Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 7508a86facdb4ff98b171aa75962dde5 Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-VolumesActionsTest-287805984 Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:33:09.156146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:33:09.158684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7508a86facdb4ff98b171aa75962dde5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/7508a86facdb4ff98b171aa75962dde5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/7508a86facdb4ff98b171aa75962dde5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_7508a86facdb4ff98b171aa75962dde5", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:33:09.158684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-VolumesActionsTest-287805984 Aug 22 17:33:09.158684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 7508a86facdb4ff98b171aa75962dde5 Aug 22 17:33:09.158684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-VolumesActionsTest-287805984 Aug 22 17:33:09.158684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-VolumesActionsTest-287805984-project Aug 22 17:33:09.158684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:33:09.158684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:33:09.158684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 2351ea9262c44d74827e79231d1813c6 Aug 22 17:33:09.158684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-VolumesActionsTest-287805984-project Aug 22 17:33:09.158684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:33:09.158684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance 52dc487f-6ba1-4c5a-a5e8-c6f51d640339 could not be found. Aug 22 17:33:09.158684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '52dc487f-6ba1-4c5a-a5e8-c6f51d640339'} Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52dc487f-6ba1-4c5a-a5e8-c6f51d640339 could not be found. Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:33:09.160028 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52dc487f-6ba1-4c5a-a5e8-c6f51d640339 could not be found. Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52dc487f-6ba1-4c5a-a5e8-c6f51d640339 could not be found. Aug 22 17:33:09.162613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:09.164640 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6868cb2f-22f6-4de7-9b93-54af368150b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] Returning 404 to user: Instance 52dc487f-6ba1-4c5a-a5e8-c6f51d640339 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:33:09.164640 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6868cb2f-22f6-4de7-9b93-54af368150b7 tempest-VolumesActionsTest-287805984 tempest-VolumesActionsTest-287805984-project] 10.222.0.20 "GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339" status: 404 len: 111 microversion: 2.1 time: 0.038096 Aug 22 17:33:09.164640 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 293/583] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:09 2022] GET /compute/v2.1/servers/52dc487f-6ba1-4c5a-a5e8-c6f51d640339 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:33:09.481589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-36c7c098-a450-48e7-b93f-ff644cfa9dcd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:09.482866 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-36c7c098-a450-48e7-b93f-ff644cfa9dcd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:09.491902 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-36c7c098-a450-48e7-b93f-ff644cfa9dcd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:09.492816 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-36c7c098-a450-48e7-b93f-ff644cfa9dcd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:09.493487 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-36c7c098-a450-48e7-b93f-ff644cfa9dcd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:09.494756 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-36c7c098-a450-48e7-b93f-ff644cfa9dcd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:09.495475 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-36c7c098-a450-48e7-b93f-ff644cfa9dcd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:09.498449 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-36c7c098-a450-48e7-b93f-ff644cfa9dcd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:09.632113 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a1e85e81-a5a3-4710-b55f-3568bd12d42e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:09.633349 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a1e85e81-a5a3-4710-b55f-3568bd12d42e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:09.645537 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1e85e81-a5a3-4710-b55f-3568bd12d42e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:09.646517 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1e85e81-a5a3-4710-b55f-3568bd12d42e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:09.647598 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1e85e81-a5a3-4710-b55f-3568bd12d42e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:09.649686 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1e85e81-a5a3-4710-b55f-3568bd12d42e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:09.649887 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1e85e81-a5a3-4710-b55f-3568bd12d42e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:09.650555 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1e85e81-a5a3-4710-b55f-3568bd12d42e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:09.698511 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-36c7c098-a450-48e7-b93f-ff644cfa9dcd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:09.710826 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-36c7c098-a450-48e7-b93f-ff644cfa9dcd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:09.712470 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-36c7c098-a450-48e7-b93f-ff644cfa9dcd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:09.713756 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-36c7c098-a450-48e7-b93f-ff644cfa9dcd tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.240384 Aug 22 17:33:09.714338 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 291/584] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:09 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:33:09.857063 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-64a43450-0cb0-46d5-b8f3-d97791b7705e tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:09.860891 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-64a43450-0cb0-46d5-b8f3-d97791b7705e tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:09.874264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-64a43450-0cb0-46d5-b8f3-d97791b7705e tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:09.880612 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-64a43450-0cb0-46d5-b8f3-d97791b7705e tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:09.880612 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-64a43450-0cb0-46d5-b8f3-d97791b7705e tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:09.880612 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-64a43450-0cb0-46d5-b8f3-d97791b7705e tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:09.880612 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-64a43450-0cb0-46d5-b8f3-d97791b7705e tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:09.881337 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-64a43450-0cb0-46d5-b8f3-d97791b7705e tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:09.889912 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a1e85e81-a5a3-4710-b55f-3568bd12d42e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:09.907130 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a1e85e81-a5a3-4710-b55f-3568bd12d42e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.282900 Aug 22 17:33:09.908591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 294/585] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:09 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:10.203192 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-64a43450-0cb0-46d5-b8f3-d97791b7705e tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:10.212669 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-64a43450-0cb0-46d5-b8f3-d97791b7705e tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.369882 Aug 22 17:33:10.213517 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 292/586] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:09 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:10.750237 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-afabce7e-9292-46d2-8c80-fd0f59b86573 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:10.751049 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-afabce7e-9292-46d2-8c80-fd0f59b86573 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:10.758343 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afabce7e-9292-46d2-8c80-fd0f59b86573 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:10.758875 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afabce7e-9292-46d2-8c80-fd0f59b86573 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:10.759318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afabce7e-9292-46d2-8c80-fd0f59b86573 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:10.760058 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afabce7e-9292-46d2-8c80-fd0f59b86573 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:10.760775 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afabce7e-9292-46d2-8c80-fd0f59b86573 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:10.761775 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afabce7e-9292-46d2-8c80-fd0f59b86573 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:10.952491 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-afabce7e-9292-46d2-8c80-fd0f59b86573 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:10.957045 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-dba7a896-6eaf-45ec-8fd2-7f00c10d6997 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:10.958077 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-dba7a896-6eaf-45ec-8fd2-7f00c10d6997 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:10.970519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-afabce7e-9292-46d2-8c80-fd0f59b86573 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:10.970819 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dba7a896-6eaf-45ec-8fd2-7f00c10d6997 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:10.971515 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dba7a896-6eaf-45ec-8fd2-7f00c10d6997 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:10.972669 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dba7a896-6eaf-45ec-8fd2-7f00c10d6997 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:10.974168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dba7a896-6eaf-45ec-8fd2-7f00c10d6997 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:10.975021 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dba7a896-6eaf-45ec-8fd2-7f00c10d6997 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:10.975766 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dba7a896-6eaf-45ec-8fd2-7f00c10d6997 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:10.980778 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-afabce7e-9292-46d2-8c80-fd0f59b86573 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:10.983632 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-afabce7e-9292-46d2-8c80-fd0f59b86573 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.237964 Aug 22 17:33:10.985361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 295/587] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:10 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:33:11.176765 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-dba7a896-6eaf-45ec-8fd2-7f00c10d6997 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:11.186619 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-dba7a896-6eaf-45ec-8fd2-7f00c10d6997 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1737 microversion: 2.1 time: 0.238571 Aug 22 17:33:11.188218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 293/588] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:10 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:11.236540 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-23695fb5-4dbf-47ce-9dc1-1e0939742d90 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:11.237361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-23695fb5-4dbf-47ce-9dc1-1e0939742d90 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:11.244505 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-23695fb5-4dbf-47ce-9dc1-1e0939742d90 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:11.244998 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-23695fb5-4dbf-47ce-9dc1-1e0939742d90 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:11.245455 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-23695fb5-4dbf-47ce-9dc1-1e0939742d90 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:11.247620 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-23695fb5-4dbf-47ce-9dc1-1e0939742d90 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:11.248089 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-23695fb5-4dbf-47ce-9dc1-1e0939742d90 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:11.248522 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-23695fb5-4dbf-47ce-9dc1-1e0939742d90 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:11.403343 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-23695fb5-4dbf-47ce-9dc1-1e0939742d90 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:11.412006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-23695fb5-4dbf-47ce-9dc1-1e0939742d90 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.179328 Aug 22 17:33:11.412903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 296/589] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:11 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:12.010921 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d8e688c1-e66b-4275-bfbe-6581ff4d51f0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:12.011617 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d8e688c1-e66b-4275-bfbe-6581ff4d51f0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:12.018660 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8e688c1-e66b-4275-bfbe-6581ff4d51f0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:12.019150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8e688c1-e66b-4275-bfbe-6581ff4d51f0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:12.019599 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8e688c1-e66b-4275-bfbe-6581ff4d51f0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:12.020290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8e688c1-e66b-4275-bfbe-6581ff4d51f0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:12.020736 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8e688c1-e66b-4275-bfbe-6581ff4d51f0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:12.021152 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d8e688c1-e66b-4275-bfbe-6581ff4d51f0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:12.192416 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d8e688c1-e66b-4275-bfbe-6581ff4d51f0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:12.203489 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d8e688c1-e66b-4275-bfbe-6581ff4d51f0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:12.205268 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d8e688c1-e66b-4275-bfbe-6581ff4d51f0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:12.206517 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d8e688c1-e66b-4275-bfbe-6581ff4d51f0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.199802 Aug 22 17:33:12.207176 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 294/590] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:12 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:33:12.211055 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-793f8015-c807-4cb5-80ae-e32eb18a4838 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:12.211666 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-793f8015-c807-4cb5-80ae-e32eb18a4838 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:12.214379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:12.220348 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-793f8015-c807-4cb5-80ae-e32eb18a4838 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:12.220857 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-793f8015-c807-4cb5-80ae-e32eb18a4838 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:12.221294 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-793f8015-c807-4cb5-80ae-e32eb18a4838 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:12.222029 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-793f8015-c807-4cb5-80ae-e32eb18a4838 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:12.222535 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-793f8015-c807-4cb5-80ae-e32eb18a4838 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:12.223040 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-793f8015-c807-4cb5-80ae-e32eb18a4838 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:12.378449 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-793f8015-c807-4cb5-80ae-e32eb18a4838 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:12.388335 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-793f8015-c807-4cb5-80ae-e32eb18a4838 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1717 microversion: 2.1 time: 0.181502 Aug 22 17:33:12.388986 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 297/591] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:12 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1717 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:12.440066 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5fec1800-f45e-4a03-972e-837425e8db12 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:12.441168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5fec1800-f45e-4a03-972e-837425e8db12 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:12.452022 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5fec1800-f45e-4a03-972e-837425e8db12 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:12.452511 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5fec1800-f45e-4a03-972e-837425e8db12 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:12.452944 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5fec1800-f45e-4a03-972e-837425e8db12 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:12.453648 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5fec1800-f45e-4a03-972e-837425e8db12 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:12.454097 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5fec1800-f45e-4a03-972e-837425e8db12 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:12.454546 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5fec1800-f45e-4a03-972e-837425e8db12 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:12.456018 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9986b085-3799-49db-9538-4984d3e0a1dd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:12.456660 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9986b085-3799-49db-9538-4984d3e0a1dd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:12.463811 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9986b085-3799-49db-9538-4984d3e0a1dd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:12.465326 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9986b085-3799-49db-9538-4984d3e0a1dd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:12.466015 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9986b085-3799-49db-9538-4984d3e0a1dd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:12.466956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9986b085-3799-49db-9538-4984d3e0a1dd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:12.467715 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9986b085-3799-49db-9538-4984d3e0a1dd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:12.468296 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9986b085-3799-49db-9538-4984d3e0a1dd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:12.655083 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5fec1800-f45e-4a03-972e-837425e8db12 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:12.667056 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5fec1800-f45e-4a03-972e-837425e8db12 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.235656 Aug 22 17:33:12.668454 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 295/592] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:12 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:12.679953 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-9986b085-3799-49db-9538-4984d3e0a1dd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] HTTP exception thrown: Cannot 'detach_volume' instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 while it is in vm_state rescued Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9986b085-3799-49db-9538-4984d3e0a1dd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Request method failure captured: Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: DELETE /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-volume_attachments/0fd9c053-bd29-4360-bdd3-dcecd7d4bed6 HTTP/1.1 Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xXN8baaPK_MH4cED3CcghEWE-YceYDcUGSHqs14knAq32J1JqzpO0cyhzH_BH89JF7lD9EeFtriNkgpyiRD5SIvJiBn9c3eg-HMVaHqC4GnaFGBixvu6HvsWUG2lq4eV2Tb6cR5BguIlgiXJnd81Kk1-dMJMjSy3tqg7llKtV_pTM Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: de12c2563d50474cac799d50041a2fa0 Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:33:12.681770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:33:12.684678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de12c2563d50474cac799d50041a2fa0", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:33:12.684678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:33:12.684678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: de12c2563d50474cac799d50041a2fa0 Aug 22 17:33:12.684678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:33:12.684678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-ServerRescueNegativeTestJSON-1723447613-project Aug 22 17:33:12.684678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:33:12.684678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:33:12.684678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: f46cbc7de18c4f9fb6f54e96be53fea0 Aug 22 17:33:12.684678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1723447613-project Aug 22 17:33:12.684678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:33:12.684678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Cannot 'detach_volume' instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 while it is in vm_state rescued Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'server_id': '66347883-f0bf-4bbb-ba12-db82ee8d89c3', 'id': '0fd9c053-bd29-4360-bdd3-dcecd7d4bed6'} Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:33:12.686006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 while it is in vm_state rescued Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 while it is in vm_state rescued Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:12.688451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9986b085-3799-49db-9538-4984d3e0a1dd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Returning 409 to user: Cannot 'detach_volume' instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 while it is in vm_state rescued {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:33:12.690128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9986b085-3799-49db-9538-4984d3e0a1dd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "DELETE /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-volume_attachments/0fd9c053-bd29-4360-bdd3-dcecd7d4bed6" status: 409 len: 152 microversion: 2.1 time: 0.233963 Aug 22 17:33:12.690128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 298/593] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 22 17:33:12 2022] DELETE /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-volume_attachments/0fd9c053-bd29-4360-bdd3-dcecd7d4bed6 => generated 152 bytes in 236 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 22 17:33:12.696823 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6a4c32f9-571b-4d55-aa4c-1d264f9eeb02 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:12.697444 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6a4c32f9-571b-4d55-aa4c-1d264f9eeb02 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:12.704409 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a4c32f9-571b-4d55-aa4c-1d264f9eeb02 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:12.704907 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a4c32f9-571b-4d55-aa4c-1d264f9eeb02 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:12.705338 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a4c32f9-571b-4d55-aa4c-1d264f9eeb02 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:12.706050 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a4c32f9-571b-4d55-aa4c-1d264f9eeb02 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:12.706537 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a4c32f9-571b-4d55-aa4c-1d264f9eeb02 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:12.706972 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a4c32f9-571b-4d55-aa4c-1d264f9eeb02 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:12.711427 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=100 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:12.930678 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6a4c32f9-571b-4d55-aa4c-1d264f9eeb02 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "POST /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/action" status: 202 len: 0 microversion: 2.1 time: 0.238160 Aug 22 17:33:12.931544 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 296/594] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 22 17:33:12 2022] POST /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:33:12.940506 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a0bef9fb-5da5-425c-afe9-1d8efccf6cf4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:12.942703 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a0bef9fb-5da5-425c-afe9-1d8efccf6cf4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:12.951748 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a0bef9fb-5da5-425c-afe9-1d8efccf6cf4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:12.952348 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a0bef9fb-5da5-425c-afe9-1d8efccf6cf4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:12.952865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a0bef9fb-5da5-425c-afe9-1d8efccf6cf4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:12.953661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a0bef9fb-5da5-425c-afe9-1d8efccf6cf4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:12.954149 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a0bef9fb-5da5-425c-afe9-1d8efccf6cf4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:12.954670 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a0bef9fb-5da5-425c-afe9-1d8efccf6cf4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:13.116217 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a0bef9fb-5da5-425c-afe9-1d8efccf6cf4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:13.128215 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a0bef9fb-5da5-425c-afe9-1d8efccf6cf4 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1725 microversion: 2.1 time: 0.191836 Aug 22 17:33:13.128856 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 299/595] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:12 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1725 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:13.249845 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-25c1a454-151c-4f05-892c-1990ffef0f59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:13.251020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-25c1a454-151c-4f05-892c-1990ffef0f59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:13.262160 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-25c1a454-151c-4f05-892c-1990ffef0f59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:13.263030 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-25c1a454-151c-4f05-892c-1990ffef0f59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:13.263779 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-25c1a454-151c-4f05-892c-1990ffef0f59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:13.265048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-25c1a454-151c-4f05-892c-1990ffef0f59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:13.265861 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-25c1a454-151c-4f05-892c-1990ffef0f59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:13.266676 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-25c1a454-151c-4f05-892c-1990ffef0f59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:13.444074 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-25c1a454-151c-4f05-892c-1990ffef0f59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:13.460348 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-25c1a454-151c-4f05-892c-1990ffef0f59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:13.463734 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-25c1a454-151c-4f05-892c-1990ffef0f59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:13.466704 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-25c1a454-151c-4f05-892c-1990ffef0f59 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.223726 Aug 22 17:33:13.467786 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 297/596] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:13 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:33:13.690990 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-bf5a0952-5ef4-49fe-b124-61da764c2f8a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:13.691834 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-bf5a0952-5ef4-49fe-b124-61da764c2f8a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:13.700213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf5a0952-5ef4-49fe-b124-61da764c2f8a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:13.700937 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf5a0952-5ef4-49fe-b124-61da764c2f8a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:13.701387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf5a0952-5ef4-49fe-b124-61da764c2f8a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:13.702107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf5a0952-5ef4-49fe-b124-61da764c2f8a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:13.702591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf5a0952-5ef4-49fe-b124-61da764c2f8a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:13.703065 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf5a0952-5ef4-49fe-b124-61da764c2f8a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:13.862997 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-bf5a0952-5ef4-49fe-b124-61da764c2f8a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:13.872208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-bf5a0952-5ef4-49fe-b124-61da764c2f8a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.185494 Aug 22 17:33:13.872811 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 300/597] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:13 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:14.154679 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-627c68e6-7e39-4783-a2ae-f89cce246d7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:14.155842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-627c68e6-7e39-4783-a2ae-f89cce246d7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:14.168184 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-627c68e6-7e39-4783-a2ae-f89cce246d7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:14.169033 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-627c68e6-7e39-4783-a2ae-f89cce246d7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:14.169820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-627c68e6-7e39-4783-a2ae-f89cce246d7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:14.171122 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-627c68e6-7e39-4783-a2ae-f89cce246d7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:14.171936 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-627c68e6-7e39-4783-a2ae-f89cce246d7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:14.172716 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-627c68e6-7e39-4783-a2ae-f89cce246d7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:14.352831 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-627c68e6-7e39-4783-a2ae-f89cce246d7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:14.376836 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-627c68e6-7e39-4783-a2ae-f89cce246d7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1725 microversion: 2.1 time: 0.222592 Aug 22 17:33:14.376836 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 298/598] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:14 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:14.492030 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4a18b840-d658-4b3d-adc4-23e879d923cc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:14.492651 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4a18b840-d658-4b3d-adc4-23e879d923cc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:14.501204 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4a18b840-d658-4b3d-adc4-23e879d923cc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:14.501699 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4a18b840-d658-4b3d-adc4-23e879d923cc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:14.502137 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4a18b840-d658-4b3d-adc4-23e879d923cc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:14.502893 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4a18b840-d658-4b3d-adc4-23e879d923cc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:14.503348 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4a18b840-d658-4b3d-adc4-23e879d923cc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:14.503777 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4a18b840-d658-4b3d-adc4-23e879d923cc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:14.681605 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4a18b840-d658-4b3d-adc4-23e879d923cc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:14.694883 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4a18b840-d658-4b3d-adc4-23e879d923cc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:14.697938 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4a18b840-d658-4b3d-adc4-23e879d923cc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:14.701009 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4a18b840-d658-4b3d-adc4-23e879d923cc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.212685 Aug 22 17:33:14.702024 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 301/599] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:14 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:33:14.894531 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4d8afa4a-b3f1-4223-8a7e-35468d2dd9b1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:14.895194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4d8afa4a-b3f1-4223-8a7e-35468d2dd9b1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:14.902656 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d8afa4a-b3f1-4223-8a7e-35468d2dd9b1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:14.903146 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d8afa4a-b3f1-4223-8a7e-35468d2dd9b1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:14.903759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d8afa4a-b3f1-4223-8a7e-35468d2dd9b1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:14.904483 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d8afa4a-b3f1-4223-8a7e-35468d2dd9b1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:14.904940 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d8afa4a-b3f1-4223-8a7e-35468d2dd9b1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:14.905363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d8afa4a-b3f1-4223-8a7e-35468d2dd9b1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:15.060990 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4d8afa4a-b3f1-4223-8a7e-35468d2dd9b1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:15.069662 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4d8afa4a-b3f1-4223-8a7e-35468d2dd9b1 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.179092 Aug 22 17:33:15.070261 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 299/600] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:14 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:15.393440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-66350ed3-b628-4423-b963-6da4b88a1073 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:15.393963 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-66350ed3-b628-4423-b963-6da4b88a1073 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:15.400897 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-66350ed3-b628-4423-b963-6da4b88a1073 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:15.401389 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-66350ed3-b628-4423-b963-6da4b88a1073 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:15.402220 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-66350ed3-b628-4423-b963-6da4b88a1073 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:15.402979 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-66350ed3-b628-4423-b963-6da4b88a1073 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:15.403434 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-66350ed3-b628-4423-b963-6da4b88a1073 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:15.403854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-66350ed3-b628-4423-b963-6da4b88a1073 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:15.561181 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-66350ed3-b628-4423-b963-6da4b88a1073 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:15.570125 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-66350ed3-b628-4423-b963-6da4b88a1073 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1725 microversion: 2.1 time: 0.180782 Aug 22 17:33:15.570772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 302/601] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:15 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:15.724661 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b1e3e025-1fcb-413e-a423-6d52c9f9e6bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:15.725307 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b1e3e025-1fcb-413e-a423-6d52c9f9e6bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:15.734281 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1e3e025-1fcb-413e-a423-6d52c9f9e6bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:15.734813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1e3e025-1fcb-413e-a423-6d52c9f9e6bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:15.735295 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1e3e025-1fcb-413e-a423-6d52c9f9e6bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:15.736820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1e3e025-1fcb-413e-a423-6d52c9f9e6bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:15.736820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1e3e025-1fcb-413e-a423-6d52c9f9e6bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:15.736820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1e3e025-1fcb-413e-a423-6d52c9f9e6bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:15.884627 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b1e3e025-1fcb-413e-a423-6d52c9f9e6bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:15.894603 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b1e3e025-1fcb-413e-a423-6d52c9f9e6bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:15.896205 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b1e3e025-1fcb-413e-a423-6d52c9f9e6bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:15.897404 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b1e3e025-1fcb-413e-a423-6d52c9f9e6bc tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.176737 Aug 22 17:33:15.897971 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 300/602] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:15 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:33:16.092202 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-03185058-3226-4d88-a393-76c983e41e88 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:16.092836 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-03185058-3226-4d88-a393-76c983e41e88 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:16.099750 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-03185058-3226-4d88-a393-76c983e41e88 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:16.100302 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-03185058-3226-4d88-a393-76c983e41e88 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:16.100783 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-03185058-3226-4d88-a393-76c983e41e88 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:16.101543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-03185058-3226-4d88-a393-76c983e41e88 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:16.102045 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-03185058-3226-4d88-a393-76c983e41e88 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:16.102554 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-03185058-3226-4d88-a393-76c983e41e88 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:16.264804 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-03185058-3226-4d88-a393-76c983e41e88 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:16.280341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-03185058-3226-4d88-a393-76c983e41e88 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.193051 Aug 22 17:33:16.281365 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 303/603] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:16 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:16.594366 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-63309413-cdff-486a-904c-092f97e02eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:16.595126 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-63309413-cdff-486a-904c-092f97e02eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:16.602192 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-63309413-cdff-486a-904c-092f97e02eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:16.603432 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-63309413-cdff-486a-904c-092f97e02eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:16.603432 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-63309413-cdff-486a-904c-092f97e02eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:16.604140 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-63309413-cdff-486a-904c-092f97e02eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:16.604633 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-63309413-cdff-486a-904c-092f97e02eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:16.605690 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-63309413-cdff-486a-904c-092f97e02eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:16.776277 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-63309413-cdff-486a-904c-092f97e02eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:16.786222 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-63309413-cdff-486a-904c-092f97e02eeb tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1725 microversion: 2.1 time: 0.197075 Aug 22 17:33:16.786876 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 301/604] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:16 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:16.922264 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b46fd6d8-4428-4384-a34b-191437ba85d8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:16.923013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b46fd6d8-4428-4384-a34b-191437ba85d8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:16.930704 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b46fd6d8-4428-4384-a34b-191437ba85d8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:16.931347 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b46fd6d8-4428-4384-a34b-191437ba85d8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:16.931882 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b46fd6d8-4428-4384-a34b-191437ba85d8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:16.932743 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b46fd6d8-4428-4384-a34b-191437ba85d8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:16.933443 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b46fd6d8-4428-4384-a34b-191437ba85d8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:16.934201 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b46fd6d8-4428-4384-a34b-191437ba85d8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:17.133364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b46fd6d8-4428-4384-a34b-191437ba85d8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:17.145533 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b46fd6d8-4428-4384-a34b-191437ba85d8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:17.147555 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b46fd6d8-4428-4384-a34b-191437ba85d8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:17.148983 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b46fd6d8-4428-4384-a34b-191437ba85d8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.231402 Aug 22 17:33:17.150145 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 304/605] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:16 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:33:17.326412 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6b621644-5d49-46cc-ab66-7fa149e98af6 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:17.328134 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6b621644-5d49-46cc-ab66-7fa149e98af6 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:17.344752 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6b621644-5d49-46cc-ab66-7fa149e98af6 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:17.345823 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6b621644-5d49-46cc-ab66-7fa149e98af6 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:17.347883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6b621644-5d49-46cc-ab66-7fa149e98af6 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:17.350380 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6b621644-5d49-46cc-ab66-7fa149e98af6 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:17.351168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6b621644-5d49-46cc-ab66-7fa149e98af6 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:17.352215 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6b621644-5d49-46cc-ab66-7fa149e98af6 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:17.570443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6b621644-5d49-46cc-ab66-7fa149e98af6 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:17.585579 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6b621644-5d49-46cc-ab66-7fa149e98af6 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.267706 Aug 22 17:33:17.592036 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 302/606] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:17 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:17.816289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-957758f3-be7d-43cd-9888-de6a3212c3b8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:17.818032 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-957758f3-be7d-43cd-9888-de6a3212c3b8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:17.830793 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-957758f3-be7d-43cd-9888-de6a3212c3b8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:17.831603 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-957758f3-be7d-43cd-9888-de6a3212c3b8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:17.832557 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-957758f3-be7d-43cd-9888-de6a3212c3b8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:17.833938 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-957758f3-be7d-43cd-9888-de6a3212c3b8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:17.834759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-957758f3-be7d-43cd-9888-de6a3212c3b8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:17.836613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-957758f3-be7d-43cd-9888-de6a3212c3b8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:18.081563 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-957758f3-be7d-43cd-9888-de6a3212c3b8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:18.111638 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-957758f3-be7d-43cd-9888-de6a3212c3b8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1725 microversion: 2.1 time: 0.306715 Aug 22 17:33:18.119037 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 305/607] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:17 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1725 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:18.194827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-bd2560d4-fb4a-49ea-8797-4afe6430688f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:18.197168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-bd2560d4-fb4a-49ea-8797-4afe6430688f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:18.231579 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd2560d4-fb4a-49ea-8797-4afe6430688f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:18.235140 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd2560d4-fb4a-49ea-8797-4afe6430688f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:18.235140 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd2560d4-fb4a-49ea-8797-4afe6430688f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:18.235801 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd2560d4-fb4a-49ea-8797-4afe6430688f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:18.237166 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd2560d4-fb4a-49ea-8797-4afe6430688f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:18.239178 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd2560d4-fb4a-49ea-8797-4afe6430688f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:18.477875 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-bd2560d4-fb4a-49ea-8797-4afe6430688f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:18.512903 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-bd2560d4-fb4a-49ea-8797-4afe6430688f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:18.517048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-bd2560d4-fb4a-49ea-8797-4afe6430688f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:18.519523 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-bd2560d4-fb4a-49ea-8797-4afe6430688f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.334732 Aug 22 17:33:18.520738 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 303/608] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:18 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:33:18.620830 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9766e886-b1af-48e7-ac45-bed6430c62d5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:18.624995 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9766e886-b1af-48e7-ac45-bed6430c62d5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:18.634236 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9766e886-b1af-48e7-ac45-bed6430c62d5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:18.634766 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9766e886-b1af-48e7-ac45-bed6430c62d5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:18.635207 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9766e886-b1af-48e7-ac45-bed6430c62d5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:18.636265 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9766e886-b1af-48e7-ac45-bed6430c62d5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:18.637240 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9766e886-b1af-48e7-ac45-bed6430c62d5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:18.639192 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9766e886-b1af-48e7-ac45-bed6430c62d5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:18.849194 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9766e886-b1af-48e7-ac45-bed6430c62d5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:18.864604 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9766e886-b1af-48e7-ac45-bed6430c62d5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.249419 Aug 22 17:33:18.866317 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 306/609] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:18 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:19.148824 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cabeefff-2cc2-407e-9633-afef9d5a4a6e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:19.149943 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-cabeefff-2cc2-407e-9633-afef9d5a4a6e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:19.177434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cabeefff-2cc2-407e-9633-afef9d5a4a6e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:19.178368 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cabeefff-2cc2-407e-9633-afef9d5a4a6e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:19.179494 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cabeefff-2cc2-407e-9633-afef9d5a4a6e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:19.181082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cabeefff-2cc2-407e-9633-afef9d5a4a6e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:19.182003 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cabeefff-2cc2-407e-9633-afef9d5a4a6e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:19.183703 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cabeefff-2cc2-407e-9633-afef9d5a4a6e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:19.547095 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-83738a62-c61a-4641-8dcc-d6f9953256a1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:19.547723 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-83738a62-c61a-4641-8dcc-d6f9953256a1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:19.564130 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83738a62-c61a-4641-8dcc-d6f9953256a1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:19.564629 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83738a62-c61a-4641-8dcc-d6f9953256a1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:19.565066 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83738a62-c61a-4641-8dcc-d6f9953256a1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:19.565785 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83738a62-c61a-4641-8dcc-d6f9953256a1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:19.566248 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83738a62-c61a-4641-8dcc-d6f9953256a1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:19.566719 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83738a62-c61a-4641-8dcc-d6f9953256a1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:19.570840 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-cabeefff-2cc2-407e-9633-afef9d5a4a6e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:19.584960 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-cabeefff-2cc2-407e-9633-afef9d5a4a6e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1725 microversion: 2.1 time: 0.443224 Aug 22 17:33:19.585820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 304/610] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:19 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1725 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:19.885671 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-83738a62-c61a-4641-8dcc-d6f9953256a1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:19.899536 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a0eaf71b-3ccc-4733-afd0-76013f9cd441 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:19.902755 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a0eaf71b-3ccc-4733-afd0-76013f9cd441 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:19.920251 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-83738a62-c61a-4641-8dcc-d6f9953256a1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:19.924891 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0eaf71b-3ccc-4733-afd0-76013f9cd441 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:19.925408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-83738a62-c61a-4641-8dcc-d6f9953256a1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:19.927458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-83738a62-c61a-4641-8dcc-d6f9953256a1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.384595 Aug 22 17:33:19.927728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0eaf71b-3ccc-4733-afd0-76013f9cd441 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:19.928830 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0eaf71b-3ccc-4733-afd0-76013f9cd441 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:19.929664 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 307/611] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:19 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:33:19.930774 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0eaf71b-3ccc-4733-afd0-76013f9cd441 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:19.939268 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0eaf71b-3ccc-4733-afd0-76013f9cd441 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:19.940106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a0eaf71b-3ccc-4733-afd0-76013f9cd441 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:20.390921 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a0eaf71b-3ccc-4733-afd0-76013f9cd441 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:20.407493 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a0eaf71b-3ccc-4733-afd0-76013f9cd441 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.512887 Aug 22 17:33:20.411658 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 305/612] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:19 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:20.638514 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9a3d29aa-6ccb-4839-9b32-b431a464ca38 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:20.640083 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9a3d29aa-6ccb-4839-9b32-b431a464ca38 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:20.650006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9a3d29aa-6ccb-4839-9b32-b431a464ca38 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:20.650946 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9a3d29aa-6ccb-4839-9b32-b431a464ca38 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:20.653079 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9a3d29aa-6ccb-4839-9b32-b431a464ca38 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:20.654099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9a3d29aa-6ccb-4839-9b32-b431a464ca38 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:20.654760 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9a3d29aa-6ccb-4839-9b32-b431a464ca38 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:20.655845 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9a3d29aa-6ccb-4839-9b32-b431a464ca38 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:20.662273 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=100 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:20.891667 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9a3d29aa-6ccb-4839-9b32-b431a464ca38 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:20.920247 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9a3d29aa-6ccb-4839-9b32-b431a464ca38 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1725 microversion: 2.1 time: 0.280778 Aug 22 17:33:20.921911 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 308/613] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:20 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1725 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:20.971726 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-67c66683-7aae-4e04-af3c-93bf1b7aed42 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:20.972796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-67c66683-7aae-4e04-af3c-93bf1b7aed42 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:20.980644 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-67c66683-7aae-4e04-af3c-93bf1b7aed42 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:20.981467 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-67c66683-7aae-4e04-af3c-93bf1b7aed42 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:20.981913 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-67c66683-7aae-4e04-af3c-93bf1b7aed42 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:20.982676 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-67c66683-7aae-4e04-af3c-93bf1b7aed42 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:20.983141 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-67c66683-7aae-4e04-af3c-93bf1b7aed42 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:20.983584 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-67c66683-7aae-4e04-af3c-93bf1b7aed42 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:21.204557 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-67c66683-7aae-4e04-af3c-93bf1b7aed42 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:21.231354 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-67c66683-7aae-4e04-af3c-93bf1b7aed42 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:21.235034 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-67c66683-7aae-4e04-af3c-93bf1b7aed42 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:21.237816 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-67c66683-7aae-4e04-af3c-93bf1b7aed42 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.270821 Aug 22 17:33:21.259097 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 306/614] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:20 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:33:21.411324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-3715ff0b-f4a2-4ab9-b6f0-772d013c3b16 req-46be9af2-311d-48cf-a745-43284d1b4792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ff94bc-e986-4201-96e7-484c08490011", "name": "network-vif-plugged", "status": "completed", "tag": "a4e21f10-9c29-4641-93d3-684817ef690e"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:21.442154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-44091eac-22e5-4407-a8f1-427dd54a11b8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:21.457711 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-44091eac-22e5-4407-a8f1-427dd54a11b8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:21.489654 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-44091eac-22e5-4407-a8f1-427dd54a11b8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:21.496189 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-44091eac-22e5-4407-a8f1-427dd54a11b8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:21.497959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-44091eac-22e5-4407-a8f1-427dd54a11b8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:21.504250 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-3715ff0b-f4a2-4ab9-b6f0-772d013c3b16 req-46be9af2-311d-48cf-a745-43284d1b4792 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:21.505592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-44091eac-22e5-4407-a8f1-427dd54a11b8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:21.506275 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-44091eac-22e5-4407-a8f1-427dd54a11b8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:21.506782 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-3715ff0b-f4a2-4ab9-b6f0-772d013c3b16 req-46be9af2-311d-48cf-a745-43284d1b4792 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:21.507141 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-44091eac-22e5-4407-a8f1-427dd54a11b8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:21.507853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-3715ff0b-f4a2-4ab9-b6f0-772d013c3b16 req-46be9af2-311d-48cf-a745-43284d1b4792 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:21.556965 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-3715ff0b-f4a2-4ab9-b6f0-772d013c3b16 req-46be9af2-311d-48cf-a745-43284d1b4792 service nova] Creating event network-vif-plugged:a4e21f10-9c29-4641-93d3-684817ef690e for instance 84ff94bc-e986-4201-96e7-484c08490011 on hv-cinder-85394 Aug 22 17:33:21.578591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-3715ff0b-f4a2-4ab9-b6f0-772d013c3b16 req-46be9af2-311d-48cf-a745-43284d1b4792 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191144 Aug 22 17:33:21.582625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 309/615] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:33:21.743726 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-44091eac-22e5-4407-a8f1-427dd54a11b8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:21.753356 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-44091eac-22e5-4407-a8f1-427dd54a11b8 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.320460 Aug 22 17:33:21.766608 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 307/616] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:21 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:21.963487 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-743203f5-178d-46e3-9474-cdb8d7263fa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:21.965177 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-743203f5-178d-46e3-9474-cdb8d7263fa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:21.981181 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-743203f5-178d-46e3-9474-cdb8d7263fa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:21.983779 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-743203f5-178d-46e3-9474-cdb8d7263fa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:21.984901 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-743203f5-178d-46e3-9474-cdb8d7263fa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:21.986122 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-743203f5-178d-46e3-9474-cdb8d7263fa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:21.987447 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-743203f5-178d-46e3-9474-cdb8d7263fa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:21.988647 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-743203f5-178d-46e3-9474-cdb8d7263fa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:22.184447 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-743203f5-178d-46e3-9474-cdb8d7263fa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:22.196343 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-743203f5-178d-46e3-9474-cdb8d7263fa9 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1725 microversion: 2.1 time: 0.242160 Aug 22 17:33:22.197241 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 310/617] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:21 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:22.287835 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2cd2a5f0-bb4b-4216-9f24-faff53f9a479 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:22.289477 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2cd2a5f0-bb4b-4216-9f24-faff53f9a479 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:22.296352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2cd2a5f0-bb4b-4216-9f24-faff53f9a479 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:22.296945 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2cd2a5f0-bb4b-4216-9f24-faff53f9a479 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:22.297484 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2cd2a5f0-bb4b-4216-9f24-faff53f9a479 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:22.298286 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2cd2a5f0-bb4b-4216-9f24-faff53f9a479 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:22.299242 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2cd2a5f0-bb4b-4216-9f24-faff53f9a479 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:22.299943 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2cd2a5f0-bb4b-4216-9f24-faff53f9a479 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:22.554674 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2cd2a5f0-bb4b-4216-9f24-faff53f9a479 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:22.570625 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2cd2a5f0-bb4b-4216-9f24-faff53f9a479 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:22.574717 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2cd2a5f0-bb4b-4216-9f24-faff53f9a479 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:22.577207 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2cd2a5f0-bb4b-4216-9f24-faff53f9a479 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.293648 Aug 22 17:33:22.578724 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 308/618] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:22 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:33:22.784922 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d4d79880-131d-4ca1-8c09-eee0d7897a32 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:22.786562 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d4d79880-131d-4ca1-8c09-eee0d7897a32 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:22.799048 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d4d79880-131d-4ca1-8c09-eee0d7897a32 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:22.804339 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d4d79880-131d-4ca1-8c09-eee0d7897a32 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:22.804339 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d4d79880-131d-4ca1-8c09-eee0d7897a32 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:22.804339 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d4d79880-131d-4ca1-8c09-eee0d7897a32 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:22.804339 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d4d79880-131d-4ca1-8c09-eee0d7897a32 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:22.805363 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d4d79880-131d-4ca1-8c09-eee0d7897a32 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:22.998544 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-d4d79880-131d-4ca1-8c09-eee0d7897a32 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:23.012998 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d4d79880-131d-4ca1-8c09-eee0d7897a32 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.238068 Aug 22 17:33:23.028614 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 311/619] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:22 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:23.231472 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8fbcdb81-5f1b-4303-863b-840b9760663d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:23.233058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8fbcdb81-5f1b-4303-863b-840b9760663d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:23.243857 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8fbcdb81-5f1b-4303-863b-840b9760663d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:23.244782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8fbcdb81-5f1b-4303-863b-840b9760663d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:23.246096 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8fbcdb81-5f1b-4303-863b-840b9760663d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:23.247485 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8fbcdb81-5f1b-4303-863b-840b9760663d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:23.248374 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8fbcdb81-5f1b-4303-863b-840b9760663d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:23.249132 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8fbcdb81-5f1b-4303-863b-840b9760663d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:23.521406 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8fbcdb81-5f1b-4303-863b-840b9760663d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:23.536778 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8fbcdb81-5f1b-4303-863b-840b9760663d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1725 microversion: 2.1 time: 0.313769 Aug 22 17:33:23.540291 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 309/620] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:23 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1725 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:23.612884 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-195f7d4d-b94a-45c0-b51f-2f95068eecb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:23.613796 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-195f7d4d-b94a-45c0-b51f-2f95068eecb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:23.632358 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-195f7d4d-b94a-45c0-b51f-2f95068eecb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:23.633226 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-195f7d4d-b94a-45c0-b51f-2f95068eecb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:23.633963 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-195f7d4d-b94a-45c0-b51f-2f95068eecb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:23.635487 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-195f7d4d-b94a-45c0-b51f-2f95068eecb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:23.637016 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-195f7d4d-b94a-45c0-b51f-2f95068eecb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:23.637601 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-195f7d4d-b94a-45c0-b51f-2f95068eecb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:23.895661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-195f7d4d-b94a-45c0-b51f-2f95068eecb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:23.912560 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-195f7d4d-b94a-45c0-b51f-2f95068eecb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:23.919647 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-195f7d4d-b94a-45c0-b51f-2f95068eecb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:23.922588 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-195f7d4d-b94a-45c0-b51f-2f95068eecb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1807 microversion: 2.20 time: 0.315396 Aug 22 17:33:23.940786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 312/621] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:23 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1807 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:33:24.052341 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e52c21e1-4e28-44bf-ac56-6ed72bc2c878 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:24.053579 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e52c21e1-4e28-44bf-ac56-6ed72bc2c878 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:24.065352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e52c21e1-4e28-44bf-ac56-6ed72bc2c878 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:24.066573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e52c21e1-4e28-44bf-ac56-6ed72bc2c878 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:24.067644 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e52c21e1-4e28-44bf-ac56-6ed72bc2c878 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:24.069212 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e52c21e1-4e28-44bf-ac56-6ed72bc2c878 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:24.070429 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e52c21e1-4e28-44bf-ac56-6ed72bc2c878 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:24.072585 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e52c21e1-4e28-44bf-ac56-6ed72bc2c878 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:24.318029 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e52c21e1-4e28-44bf-ac56-6ed72bc2c878 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:24.339134 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e52c21e1-4e28-44bf-ac56-6ed72bc2c878 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.294051 Aug 22 17:33:24.341431 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 310/622] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:24 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:24.576132 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-260c1fc0-eee0-446a-9ec0-b13038286350 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:24.577356 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-260c1fc0-eee0-446a-9ec0-b13038286350 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:24.589475 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-260c1fc0-eee0-446a-9ec0-b13038286350 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:24.592642 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-260c1fc0-eee0-446a-9ec0-b13038286350 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:24.592642 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-260c1fc0-eee0-446a-9ec0-b13038286350 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:24.594074 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-260c1fc0-eee0-446a-9ec0-b13038286350 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:24.594883 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-260c1fc0-eee0-446a-9ec0-b13038286350 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:24.600609 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-260c1fc0-eee0-446a-9ec0-b13038286350 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:24.842291 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-260c1fc0-eee0-446a-9ec0-b13038286350 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:24.857604 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-260c1fc0-eee0-446a-9ec0-b13038286350 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1731 microversion: 2.1 time: 0.291048 Aug 22 17:33:24.858686 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 313/623] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:24 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1731 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:24.880520 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-560a1d43-4391-4e19-a707-3cb279e71fe8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:24.881250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-560a1d43-4391-4e19-a707-3cb279e71fe8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:24.889464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-560a1d43-4391-4e19-a707-3cb279e71fe8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:24.889963 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-560a1d43-4391-4e19-a707-3cb279e71fe8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:24.890408 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-560a1d43-4391-4e19-a707-3cb279e71fe8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:24.891165 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-560a1d43-4391-4e19-a707-3cb279e71fe8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:24.891621 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-560a1d43-4391-4e19-a707-3cb279e71fe8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:24.892047 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-560a1d43-4391-4e19-a707-3cb279e71fe8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:24.950704 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f405759d-12d3-4548-91a0-4f649d7533f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:24.951527 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f405759d-12d3-4548-91a0-4f649d7533f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:24.962240 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f405759d-12d3-4548-91a0-4f649d7533f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:24.963577 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f405759d-12d3-4548-91a0-4f649d7533f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:24.964941 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f405759d-12d3-4548-91a0-4f649d7533f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:24.966265 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f405759d-12d3-4548-91a0-4f649d7533f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:24.967152 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f405759d-12d3-4548-91a0-4f649d7533f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:24.967924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f405759d-12d3-4548-91a0-4f649d7533f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:24.989825 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-560a1d43-4391-4e19-a707-3cb279e71fe8 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113382 Aug 22 17:33:24.991316 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 311/624] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 22 17:33:24 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:33:25.383691 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2efdc633-b473-4fd4-8ca6-b56a1e0c33fe tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:25.385411 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2efdc633-b473-4fd4-8ca6-b56a1e0c33fe tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:25.396482 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2efdc633-b473-4fd4-8ca6-b56a1e0c33fe tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:25.400490 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2efdc633-b473-4fd4-8ca6-b56a1e0c33fe tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:25.401897 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2efdc633-b473-4fd4-8ca6-b56a1e0c33fe tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:25.403479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2efdc633-b473-4fd4-8ca6-b56a1e0c33fe tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:25.404497 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2efdc633-b473-4fd4-8ca6-b56a1e0c33fe tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:25.405272 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2efdc633-b473-4fd4-8ca6-b56a1e0c33fe tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:25.413554 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:25.424036 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f405759d-12d3-4548-91a0-4f649d7533f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:25.453923 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f405759d-12d3-4548-91a0-4f649d7533f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:25.457736 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f405759d-12d3-4548-91a0-4f649d7533f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:25.460543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f405759d-12d3-4548-91a0-4f649d7533f1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1794 microversion: 2.20 time: 0.515002 Aug 22 17:33:25.462087 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 314/625] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:33:24 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1794 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:33:25.774254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2efdc633-b473-4fd4-8ca6-b56a1e0c33fe tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:25.791487 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2efdc633-b473-4fd4-8ca6-b56a1e0c33fe tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1358 microversion: 2.1 time: 0.415044 Aug 22 17:33:25.802549 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 312/626] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:25 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1358 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:26.829039 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e8b86190-8cb4-4c7c-a7de-eeaa5ccd5047 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:26.830068 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e8b86190-8cb4-4c7c-a7de-eeaa5ccd5047 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:26.843281 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e8b86190-8cb4-4c7c-a7de-eeaa5ccd5047 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:26.848419 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e8b86190-8cb4-4c7c-a7de-eeaa5ccd5047 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:26.849090 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e8b86190-8cb4-4c7c-a7de-eeaa5ccd5047 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:26.849863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e8b86190-8cb4-4c7c-a7de-eeaa5ccd5047 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:26.850335 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e8b86190-8cb4-4c7c-a7de-eeaa5ccd5047 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:26.850822 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e8b86190-8cb4-4c7c-a7de-eeaa5ccd5047 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:27.217883 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e8b86190-8cb4-4c7c-a7de-eeaa5ccd5047 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:27.246941 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e8b86190-8cb4-4c7c-a7de-eeaa5ccd5047 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1548 microversion: 2.1 time: 0.422130 Aug 22 17:33:27.262870 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 315/627] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:26 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1548 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:27.273453 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d9e82275-1864-4e49-afcd-1c0de27f935a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:27.274812 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d9e82275-1864-4e49-afcd-1c0de27f935a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:27.287706 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d9e82275-1864-4e49-afcd-1c0de27f935a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:27.288605 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d9e82275-1864-4e49-afcd-1c0de27f935a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:27.292465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d9e82275-1864-4e49-afcd-1c0de27f935a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:27.293462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d9e82275-1864-4e49-afcd-1c0de27f935a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:27.294152 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d9e82275-1864-4e49-afcd-1c0de27f935a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:27.294697 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d9e82275-1864-4e49-afcd-1c0de27f935a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:27.627591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-7c988d59-b2c6-4795-98fd-cedfa0f27931 req-2a711f66-3bbb-4de9-9d17-a1653240bb01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66347883-f0bf-4bbb-ba12-db82ee8d89c3", "tag": "c920306a-84f5-4723-a57f-bb8dc17b0207"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:27.646346 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d9e82275-1864-4e49-afcd-1c0de27f935a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:27.658294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d9e82275-1864-4e49-afcd-1c0de27f935a tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1548 microversion: 2.1 time: 0.388847 Aug 22 17:33:27.661214 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 313/628] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:27 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1548 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:27.684684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-7c988d59-b2c6-4795-98fd-cedfa0f27931 req-2a711f66-3bbb-4de9-9d17-a1653240bb01 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:27.686221 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-7c988d59-b2c6-4795-98fd-cedfa0f27931 req-2a711f66-3bbb-4de9-9d17-a1653240bb01 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:27.687517 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-7c988d59-b2c6-4795-98fd-cedfa0f27931 req-2a711f66-3bbb-4de9-9d17-a1653240bb01 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:27.693694 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ff6df280-e26c-49e8-95fb-25b1a2509ac5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:27.706353 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-7c988d59-b2c6-4795-98fd-cedfa0f27931 req-2a711f66-3bbb-4de9-9d17-a1653240bb01 service nova] Creating event network-changed:c920306a-84f5-4723-a57f-bb8dc17b0207 for instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 on hv-cinder-85394 Aug 22 17:33:27.715295 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ff6df280-e26c-49e8-95fb-25b1a2509ac5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:27.717306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ff6df280-e26c-49e8-95fb-25b1a2509ac5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Searching by: {'deleted': False, 'project_id': '11871f979145455499b30912da1abcfd'} {{(pid=121853) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 22 17:33:27.718106 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-7c988d59-b2c6-4795-98fd-cedfa0f27931 req-2a711f66-3bbb-4de9-9d17-a1653240bb01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099230 Aug 22 17:33:27.719307 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 316/629] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:33:27.737454 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ff6df280-e26c-49e8-95fb-25b1a2509ac5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:27.739372 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ff6df280-e26c-49e8-95fb-25b1a2509ac5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:27.740066 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ff6df280-e26c-49e8-95fb-25b1a2509ac5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:27.742108 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ff6df280-e26c-49e8-95fb-25b1a2509ac5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:27.742993 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ff6df280-e26c-49e8-95fb-25b1a2509ac5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:27.744012 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ff6df280-e26c-49e8-95fb-25b1a2509ac5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:27.992395 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.multi_cell_list [None req-ff6df280-e26c-49e8-95fb-25b1a2509ac5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121853) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 22 17:33:28.252238 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ff6df280-e26c-49e8-95fb-25b1a2509ac5 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.565007 Aug 22 17:33:28.253731 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 314/630] 10.222.0.20 () {58 vars in 1125 bytes} [Mon Aug 22 17:33:27 2022] GET /compute/v2.1/servers => generated 343 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:33:28.282019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-cf1c07aa-d44b-499a-a4f9-65b0d3991c00 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:28.284575 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-cf1c07aa-d44b-499a-a4f9-65b0d3991c00 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:28.340436 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cf1c07aa-d44b-499a-a4f9-65b0d3991c00 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:28.347586 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cf1c07aa-d44b-499a-a4f9-65b0d3991c00 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:28.347586 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cf1c07aa-d44b-499a-a4f9-65b0d3991c00 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:28.347586 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cf1c07aa-d44b-499a-a4f9-65b0d3991c00 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:28.347586 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cf1c07aa-d44b-499a-a4f9-65b0d3991c00 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:28.348418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cf1c07aa-d44b-499a-a4f9-65b0d3991c00 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:28.721152 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-cf1c07aa-d44b-499a-a4f9-65b0d3991c00 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:28.757088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-cf1c07aa-d44b-499a-a4f9-65b0d3991c00 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1548 microversion: 2.1 time: 0.484797 Aug 22 17:33:28.759565 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 317/631] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:28 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1548 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:29.737887 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-92d05382-f83d-4488-a771-e0123b211bdf req-101a2849-ee4a-4c8a-b637-57bf11842033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66347883-f0bf-4bbb-ba12-db82ee8d89c3", "tag": "c920306a-84f5-4723-a57f-bb8dc17b0207"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:29.752945 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-92d05382-f83d-4488-a771-e0123b211bdf req-101a2849-ee4a-4c8a-b637-57bf11842033 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:29.753777 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-92d05382-f83d-4488-a771-e0123b211bdf req-101a2849-ee4a-4c8a-b637-57bf11842033 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:29.754718 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-92d05382-f83d-4488-a771-e0123b211bdf req-101a2849-ee4a-4c8a-b637-57bf11842033 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:29.779398 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-92d05382-f83d-4488-a771-e0123b211bdf req-101a2849-ee4a-4c8a-b637-57bf11842033 service nova] Creating event network-changed:c920306a-84f5-4723-a57f-bb8dc17b0207 for instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 on hv-cinder-85394 Aug 22 17:33:29.797062 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-92d05382-f83d-4488-a771-e0123b211bdf req-101a2849-ee4a-4c8a-b637-57bf11842033 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063203 Aug 22 17:33:29.798079 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 315/632] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:33:31.238574 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e12680cb-2ad9-4626-8224-deb69b27b47f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ad88b0b-3803-466d-9bb0-c1a0ad6b0c0f"}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:31.243176 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e12680cb-2ad9-4626-8224-deb69b27b47f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:31.257525 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e12680cb-2ad9-4626-8224-deb69b27b47f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:31.259203 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e12680cb-2ad9-4626-8224-deb69b27b47f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:31.260342 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e12680cb-2ad9-4626-8224-deb69b27b47f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:31.261935 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e12680cb-2ad9-4626-8224-deb69b27b47f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:31.262740 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e12680cb-2ad9-4626-8224-deb69b27b47f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:31.263418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e12680cb-2ad9-4626-8224-deb69b27b47f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:32.305766 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e12680cb-2ad9-4626-8224-deb69b27b47f tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "POST /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.076424 Aug 22 17:33:32.307856 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 318/633] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 22 17:33:31 2022] POST /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/os-volume_attachments => generated 194 bytes in 1081 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:33:41.327873 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:41.328708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=56 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:41.329397 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=20 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:41.334288 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-90a24030-00ed-4367-9bba-a220aedd1658 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:41.335417 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-90a24030-00ed-4367-9bba-a220aedd1658 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:41.347269 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-90a24030-00ed-4367-9bba-a220aedd1658 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:41.348045 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-90a24030-00ed-4367-9bba-a220aedd1658 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:41.348764 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-90a24030-00ed-4367-9bba-a220aedd1658 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:41.349938 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-90a24030-00ed-4367-9bba-a220aedd1658 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:41.350720 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-90a24030-00ed-4367-9bba-a220aedd1658 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:41.351414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-90a24030-00ed-4367-9bba-a220aedd1658 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:41.529300 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-90a24030-00ed-4367-9bba-a220aedd1658 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:41.538696 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-90a24030-00ed-4367-9bba-a220aedd1658 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1594 microversion: 2.1 time: 0.212220 Aug 22 17:33:41.539370 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 316/634] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:41 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1594 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:44.463174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=43 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:44.465653 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:44.474942 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-df451052-6136-4003-8a05-accf138b62a4 req-2f80012c-725b-4f79-8865-b0426e863f91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ff94bc-e986-4201-96e7-484c08490011", "tag": "a4e21f10-9c29-4641-93d3-684817ef690e"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:44.496941 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-df451052-6136-4003-8a05-accf138b62a4 req-2f80012c-725b-4f79-8865-b0426e863f91 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:44.498383 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-df451052-6136-4003-8a05-accf138b62a4 req-2f80012c-725b-4f79-8865-b0426e863f91 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:44.499852 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-df451052-6136-4003-8a05-accf138b62a4 req-2f80012c-725b-4f79-8865-b0426e863f91 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:44.525153 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-df451052-6136-4003-8a05-accf138b62a4 req-2f80012c-725b-4f79-8865-b0426e863f91 service nova] Creating event network-changed:a4e21f10-9c29-4641-93d3-684817ef690e for instance 84ff94bc-e986-4201-96e7-484c08490011 on hv-cinder-85394 Aug 22 17:33:44.536262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-df451052-6136-4003-8a05-accf138b62a4 req-2f80012c-725b-4f79-8865-b0426e863f91 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077474 Aug 22 17:33:44.537807 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 319/635] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:33:47.844896 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cb4a1539-e311-411a-a706-8ba0ae3c1336 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2018233057"}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:47.845987 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-cb4a1539-e311-411a-a706-8ba0ae3c1336 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:47.855966 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb4a1539-e311-411a-a706-8ba0ae3c1336 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:47.856519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb4a1539-e311-411a-a706-8ba0ae3c1336 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:47.857802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb4a1539-e311-411a-a706-8ba0ae3c1336 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:47.857802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb4a1539-e311-411a-a706-8ba0ae3c1336 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:47.858380 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb4a1539-e311-411a-a706-8ba0ae3c1336 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:47.859077 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cb4a1539-e311-411a-a706-8ba0ae3c1336 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:48.013258 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.network.security_group_api [None req-cb4a1539-e311-411a-a706-8ba0ae3c1336 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Adding security group e256c206-fd20-460d-bc15-ff85bd2bab95 to port a4e21f10-9c29-4641-93d3-684817ef690e Aug 22 17:33:48.579635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2012472496", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452"}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:48.638426 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-cb4a1539-e311-411a-a706-8ba0ae3c1336 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "POST /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/action" status: 202 len: 0 microversion: 2.1 time: 0.801791 Aug 22 17:33:48.638426 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 317/636] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 22 17:33:47 2022] POST /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/action => generated 0 bytes in 804 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:33:48.653183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6c517ebd-7f16-4587-b96b-6b8681744017 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:48.654195 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6c517ebd-7f16-4587-b96b-6b8681744017 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:48.666877 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6c517ebd-7f16-4587-b96b-6b8681744017 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:48.667822 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6c517ebd-7f16-4587-b96b-6b8681744017 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:48.670929 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6c517ebd-7f16-4587-b96b-6b8681744017 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:48.674677 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6c517ebd-7f16-4587-b96b-6b8681744017 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:48.675623 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6c517ebd-7f16-4587-b96b-6b8681744017 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:48.681402 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6c517ebd-7f16-4587-b96b-6b8681744017 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:48.698673 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.network.neutron [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] validate_networks() for None {{(pid=121852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:33:48.957029 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6c517ebd-7f16-4587-b96b-6b8681744017 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:48.977941 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6c517ebd-7f16-4587-b96b-6b8681744017 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1760 microversion: 2.1 time: 0.327836 Aug 22 17:33:48.991284 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 318/637] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:48 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1760 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:49.021204 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-aec7f236-a2d8-4128-aa0d-db53ce6a9fee req-0bf3f933-cfcd-4c9b-9157-349d7b371d74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ff94bc-e986-4201-96e7-484c08490011", "tag": "a4e21f10-9c29-4641-93d3-684817ef690e"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:49.046375 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-aec7f236-a2d8-4128-aa0d-db53ce6a9fee req-0bf3f933-cfcd-4c9b-9157-349d7b371d74 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:49.047699 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-aec7f236-a2d8-4128-aa0d-db53ce6a9fee req-0bf3f933-cfcd-4c9b-9157-349d7b371d74 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:49.048933 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-aec7f236-a2d8-4128-aa0d-db53ce6a9fee req-0bf3f933-cfcd-4c9b-9157-349d7b371d74 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:49.078041 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-aec7f236-a2d8-4128-aa0d-db53ce6a9fee req-0bf3f933-cfcd-4c9b-9157-349d7b371d74 service nova] Creating event network-changed:a4e21f10-9c29-4641-93d3-684817ef690e for instance 84ff94bc-e986-4201-96e7-484c08490011 on hv-cinder-85394 Aug 22 17:33:49.089339 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-aec7f236-a2d8-4128-aa0d-db53ce6a9fee req-0bf3f933-cfcd-4c9b-9157-349d7b371d74 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081413 Aug 22 17:33:49.091080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 319/638] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:33:49.636869 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Flavor limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:33:49.639999 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Image limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:33:49.639999 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Flavor pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:33:49.639999 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Image pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:33:49.640329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:33:49.658293 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:49.659268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:49.660046 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:49.662555 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:49.663171 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:49.663950 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:49.690581 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Getting quotas for project 956e52f3b5824c6b8d473ae0fef859c4. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:33:49.695533 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Getting quotas for user 59d328d707b7409288cd118aecd6af54 and project 956e52f3b5824c6b8d473ae0fef859c4. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:33:49.709833 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Going to run 1 instances... {{(pid=121852) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:33:49.712352 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:33:49.872327 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a4e6e345-8f49-46e6-b3bc-e9d02489cdef tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.297705 Aug 22 17:33:49.879130 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 320/639] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:33:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1306 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 17:33:49.894782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-93817bb7-7cf2-41be-93ba-02977733b22c tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:49.897058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-93817bb7-7cf2-41be-93ba-02977733b22c tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:50.025000 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-93817bb7-7cf2-41be-93ba-02977733b22c tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:50.042431 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-93817bb7-7cf2-41be-93ba-02977733b22c tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1215 microversion: 2.1 time: 0.159689 Aug 22 17:33:50.043782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 320/640] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:49 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1215 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:51.065443 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9d26cc3f-99d9-4da7-bb0b-b7af19d97629 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:51.066241 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9d26cc3f-99d9-4da7-bb0b-b7af19d97629 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:51.074329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d26cc3f-99d9-4da7-bb0b-b7af19d97629 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:51.074903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d26cc3f-99d9-4da7-bb0b-b7af19d97629 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:51.075349 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d26cc3f-99d9-4da7-bb0b-b7af19d97629 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:51.076078 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d26cc3f-99d9-4da7-bb0b-b7af19d97629 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:51.076548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d26cc3f-99d9-4da7-bb0b-b7af19d97629 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:51.076975 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d26cc3f-99d9-4da7-bb0b-b7af19d97629 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:51.148949 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9d26cc3f-99d9-4da7-bb0b-b7af19d97629 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:51.160347 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9d26cc3f-99d9-4da7-bb0b-b7af19d97629 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1219 microversion: 2.1 time: 0.099396 Aug 22 17:33:51.160953 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 321/641] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:51 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:52.184486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-53cf41a7-187c-456c-a804-a1e6a80b28e8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:52.185447 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-53cf41a7-187c-456c-a804-a1e6a80b28e8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:52.195932 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-53cf41a7-187c-456c-a804-a1e6a80b28e8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:52.196435 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-53cf41a7-187c-456c-a804-a1e6a80b28e8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:52.196869 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-53cf41a7-187c-456c-a804-a1e6a80b28e8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:52.197593 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-53cf41a7-187c-456c-a804-a1e6a80b28e8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:52.198053 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-53cf41a7-187c-456c-a804-a1e6a80b28e8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:52.198647 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-53cf41a7-187c-456c-a804-a1e6a80b28e8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:52.271761 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-53cf41a7-187c-456c-a804-a1e6a80b28e8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:52.282414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-53cf41a7-187c-456c-a804-a1e6a80b28e8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1267 microversion: 2.1 time: 0.103126 Aug 22 17:33:52.283306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 321/642] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:52 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1267 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:53.314569 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f0cbea9b-7bc2-44cd-a919-bdc08e4b642a tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:53.315371 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f0cbea9b-7bc2-44cd-a919-bdc08e4b642a tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:53.323320 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0cbea9b-7bc2-44cd-a919-bdc08e4b642a tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:53.323792 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0cbea9b-7bc2-44cd-a919-bdc08e4b642a tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:53.324233 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0cbea9b-7bc2-44cd-a919-bdc08e4b642a tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:53.325036 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0cbea9b-7bc2-44cd-a919-bdc08e4b642a tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:53.325484 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0cbea9b-7bc2-44cd-a919-bdc08e4b642a tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:53.325917 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0cbea9b-7bc2-44cd-a919-bdc08e4b642a tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:53.417708 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f0cbea9b-7bc2-44cd-a919-bdc08e4b642a tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:53.427629 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f0cbea9b-7bc2-44cd-a919-bdc08e4b642a tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1273 microversion: 2.1 time: 0.117139 Aug 22 17:33:53.428370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 322/643] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:53 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:54.458663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e1e81eea-18b3-4712-a5f3-f7979e1b449e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:54.460146 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e1e81eea-18b3-4712-a5f3-f7979e1b449e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:54.468258 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e1e81eea-18b3-4712-a5f3-f7979e1b449e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:54.468929 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e1e81eea-18b3-4712-a5f3-f7979e1b449e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:54.469507 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e1e81eea-18b3-4712-a5f3-f7979e1b449e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:54.471456 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e1e81eea-18b3-4712-a5f3-f7979e1b449e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:54.471929 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e1e81eea-18b3-4712-a5f3-f7979e1b449e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:54.472436 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e1e81eea-18b3-4712-a5f3-f7979e1b449e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:54.669594 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e1e81eea-18b3-4712-a5f3-f7979e1b449e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:54.678027 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e1e81eea-18b3-4712-a5f3-f7979e1b449e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1315 microversion: 2.1 time: 0.223852 Aug 22 17:33:54.678636 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 322/644] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:54 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:54.813036 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-14c32e50-f3e3-41ac-bcea-0760ea3003ab req-b4b94812-fabc-4995-8206-0b3401ec3b7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cbba4e2-1078-42e9-84bc-bf56057c460f", "tag": "697017a2-ce7c-439b-a23d-a8e637d991a4"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:54.827280 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-14c32e50-f3e3-41ac-bcea-0760ea3003ab req-b4b94812-fabc-4995-8206-0b3401ec3b7c service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:54.828112 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-14c32e50-f3e3-41ac-bcea-0760ea3003ab req-b4b94812-fabc-4995-8206-0b3401ec3b7c service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:54.831790 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-14c32e50-f3e3-41ac-bcea-0760ea3003ab req-b4b94812-fabc-4995-8206-0b3401ec3b7c service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:54.843778 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-14c32e50-f3e3-41ac-bcea-0760ea3003ab req-b4b94812-fabc-4995-8206-0b3401ec3b7c service nova] Creating event network-changed:697017a2-ce7c-439b-a23d-a8e637d991a4 for instance 2cbba4e2-1078-42e9-84bc-bf56057c460f on hv-cinder-85394 Aug 22 17:33:54.850263 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-14c32e50-f3e3-41ac-bcea-0760ea3003ab req-b4b94812-fabc-4995-8206-0b3401ec3b7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045120 Aug 22 17:33:54.850925 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 323/645] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:33:55.405734 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b02333b8-46f1-4024-adcb-caf40c993042 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:55.406235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b02333b8-46f1-4024-adcb-caf40c993042 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:55.412808 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b02333b8-46f1-4024-adcb-caf40c993042 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:55.413298 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b02333b8-46f1-4024-adcb-caf40c993042 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:55.413745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b02333b8-46f1-4024-adcb-caf40c993042 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:55.414469 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b02333b8-46f1-4024-adcb-caf40c993042 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:55.414996 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b02333b8-46f1-4024-adcb-caf40c993042 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:55.415425 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b02333b8-46f1-4024-adcb-caf40c993042 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:55.445464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b02333b8-46f1-4024-adcb-caf40c993042 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c/ips" status: 200 len: 150 microversion: 2.1 time: 0.043875 Aug 22 17:33:55.446080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 323/646] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 22 17:33:55 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:33:55.467542 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-31f352cf-781a-4154-a58d-bf70ee06e4a3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4892817e-866b-4e98-b1aa-ecdca6121d4d"}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:33:55.472362 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-31f352cf-781a-4154-a58d-bf70ee06e4a3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:55.484553 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-31f352cf-781a-4154-a58d-bf70ee06e4a3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:55.485437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-31f352cf-781a-4154-a58d-bf70ee06e4a3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:55.486359 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-31f352cf-781a-4154-a58d-bf70ee06e4a3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:55.487642 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-31f352cf-781a-4154-a58d-bf70ee06e4a3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:55.488519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-31f352cf-781a-4154-a58d-bf70ee06e4a3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:55.489464 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-31f352cf-781a-4154-a58d-bf70ee06e4a3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:55.623179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-31f352cf-781a-4154-a58d-bf70ee06e4a3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] HTTP exception thrown: Invalid volume: volume 4892817e-866b-4e98-b1aa-ecdca6121d4d is already attached to instances: e1c1f97f-c673-4f7b-8ecf-45396ce57516 Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-31f352cf-781a-4154-a58d-bf70ee06e4a3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Request method failure captured: Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: POST /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c/os-volume_attachments HTTP/1.1 Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 74 Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xLFyP3sazpo8lNxFPukerJWviDoPTaEBmzGGnNT2hK_WSNwW1QEyJSvA7cujhX4n3KzSw_ywGF8KgQMwv_P1bklerqKHJCnSQNmsRxQWmDXBuOt_ZETYxuWcB2qstyCMegdrnu-rvFjhw-dLXTo-dX3Y3VP9AGooFNTG8HqCGsto4 Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:33:55.626530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:33:55.628854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6436020e938047408d1f979e23dd48da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6436020e938047408d1f979e23dd48da", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:33:55.628854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:33:55.628854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:33:55.628854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:33:55.628854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:33:55.628854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:33:55.628854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:33:55.628854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: b0db362075b04b2294a6268576a5bba3 Aug 22 17:33:55.628854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:33:55.628854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Aug 22 17:33:55.628854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {"volumeAttachment": {"volumeId": "4892817e-866b-4e98-b1aa-ecdca6121d4d"}} Aug 22 17:33:55.628854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Invalid volume: volume 4892817e-866b-4e98-b1aa-ecdca6121d4d is already attached to instances: e1c1f97f-c673-4f7b-8ecf-45396ce57516 Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'server_id': 'd3e55a36-fde4-47f6-bc2b-9ab85db48b7c', 'body': {'volumeAttachment': {'volumeId': '4892817e-866b-4e98-b1aa-ecdca6121d4d'}}} Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4892817e-866b-4e98-b1aa-ecdca6121d4d is already attached to instances: e1c1f97f-c673-4f7b-8ecf-45396ce57516 Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:55.630155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4892817e-866b-4e98-b1aa-ecdca6121d4d is already attached to instances: e1c1f97f-c673-4f7b-8ecf-45396ce57516 Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:33:55.632924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:33:55.637600 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:33:55.637600 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:33:55.637600 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:33:55.637600 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4892817e-866b-4e98-b1aa-ecdca6121d4d is already attached to instances: e1c1f97f-c673-4f7b-8ecf-45396ce57516 Aug 22 17:33:55.637600 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:33:55.637600 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-31f352cf-781a-4154-a58d-bf70ee06e4a3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Returning 400 to user: Invalid volume: volume 4892817e-866b-4e98-b1aa-ecdca6121d4d is already attached to instances: e1c1f97f-c673-4f7b-8ecf-45396ce57516 {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:33:55.637600 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-31f352cf-781a-4154-a58d-bf70ee06e4a3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "POST /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.170290 Aug 22 17:33:55.637600 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 324/647] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 22 17:33:55 2022] POST /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c/os-volume_attachments => generated 174 bytes in 173 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:33:55.642019 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-956a53b6-c386-4c6a-af16-d3c219cd023c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:55.642856 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-956a53b6-c386-4c6a-af16-d3c219cd023c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:55.650203 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-956a53b6-c386-4c6a-af16-d3c219cd023c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:55.651604 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-956a53b6-c386-4c6a-af16-d3c219cd023c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:55.652191 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-956a53b6-c386-4c6a-af16-d3c219cd023c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:55.653109 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-956a53b6-c386-4c6a-af16-d3c219cd023c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:55.653789 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-956a53b6-c386-4c6a-af16-d3c219cd023c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:55.654384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-956a53b6-c386-4c6a-af16-d3c219cd023c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:55.692622 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-956a53b6-c386-4c6a-af16-d3c219cd023c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Going to try to terminate instance {{(pid=121853) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:33:55.703687 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-52525af8-1352-454a-bb13-8635cfa5e5b6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:55.704866 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-52525af8-1352-454a-bb13-8635cfa5e5b6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:55.717219 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-52525af8-1352-454a-bb13-8635cfa5e5b6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:55.718076 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-52525af8-1352-454a-bb13-8635cfa5e5b6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:55.718846 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-52525af8-1352-454a-bb13-8635cfa5e5b6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:55.719920 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-52525af8-1352-454a-bb13-8635cfa5e5b6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:55.720488 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-52525af8-1352-454a-bb13-8635cfa5e5b6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:55.721189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-52525af8-1352-454a-bb13-8635cfa5e5b6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:55.895531 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-52525af8-1352-454a-bb13-8635cfa5e5b6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:55.905282 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-52525af8-1352-454a-bb13-8635cfa5e5b6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1315 microversion: 2.1 time: 0.208615 Aug 22 17:33:55.905879 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 325/648] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:55 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:56.072842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-956a53b6-c386-4c6a-af16-d3c219cd023c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 204 len: 0 microversion: 2.1 time: 0.434535 Aug 22 17:33:56.073437 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 324/649] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:33:55 2022] DELETE /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:33:56.084033 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-56eec738-d783-4e47-b28f-138db222ea14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:56.086988 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-56eec738-d783-4e47-b28f-138db222ea14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:56.092284 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-56eec738-d783-4e47-b28f-138db222ea14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:56.093006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-56eec738-d783-4e47-b28f-138db222ea14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:56.093492 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-56eec738-d783-4e47-b28f-138db222ea14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:56.094285 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-56eec738-d783-4e47-b28f-138db222ea14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:56.094883 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-56eec738-d783-4e47-b28f-138db222ea14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:56.095461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-56eec738-d783-4e47-b28f-138db222ea14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:56.250391 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-56eec738-d783-4e47-b28f-138db222ea14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:56.258970 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-56eec738-d783-4e47-b28f-138db222ea14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1682 microversion: 2.1 time: 0.179042 Aug 22 17:33:56.260414 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 326/650] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:56 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:56.929209 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-381779f9-826d-41f4-9a63-155574475e69 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:56.930516 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-381779f9-826d-41f4-9a63-155574475e69 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:56.943452 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-381779f9-826d-41f4-9a63-155574475e69 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:56.944289 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-381779f9-826d-41f4-9a63-155574475e69 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:56.945060 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-381779f9-826d-41f4-9a63-155574475e69 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:56.946314 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-381779f9-826d-41f4-9a63-155574475e69 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:56.947839 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-381779f9-826d-41f4-9a63-155574475e69 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:56.948495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-381779f9-826d-41f4-9a63-155574475e69 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:57.100038 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-381779f9-826d-41f4-9a63-155574475e69 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:57.114201 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-381779f9-826d-41f4-9a63-155574475e69 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1315 microversion: 2.1 time: 0.189844 Aug 22 17:33:57.115276 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 325/651] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:56 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:57.282250 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-886f889d-1503-4827-b516-88fb3adfa28b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:57.282858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-886f889d-1503-4827-b516-88fb3adfa28b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:57.289826 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-886f889d-1503-4827-b516-88fb3adfa28b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:57.290325 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-886f889d-1503-4827-b516-88fb3adfa28b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:57.291335 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-886f889d-1503-4827-b516-88fb3adfa28b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:57.292053 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-886f889d-1503-4827-b516-88fb3adfa28b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:57.292520 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-886f889d-1503-4827-b516-88fb3adfa28b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:57.292948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-886f889d-1503-4827-b516-88fb3adfa28b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:57.453370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-886f889d-1503-4827-b516-88fb3adfa28b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:57.462506 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-886f889d-1503-4827-b516-88fb3adfa28b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1682 microversion: 2.1 time: 0.184181 Aug 22 17:33:57.464527 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 327/652] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:57 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1682 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:33:58.138936 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-09940731-6f2c-48c3-a1d3-afdc916d864e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:58.139629 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-09940731-6f2c-48c3-a1d3-afdc916d864e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:58.151727 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-09940731-6f2c-48c3-a1d3-afdc916d864e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:58.152614 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-09940731-6f2c-48c3-a1d3-afdc916d864e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:58.153376 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-09940731-6f2c-48c3-a1d3-afdc916d864e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:58.154748 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-09940731-6f2c-48c3-a1d3-afdc916d864e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:58.155589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-09940731-6f2c-48c3-a1d3-afdc916d864e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:58.156374 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-09940731-6f2c-48c3-a1d3-afdc916d864e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:58.335680 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-09940731-6f2c-48c3-a1d3-afdc916d864e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:58.346177 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-09940731-6f2c-48c3-a1d3-afdc916d864e tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1315 microversion: 2.1 time: 0.212806 Aug 22 17:33:58.346830 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 326/653] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:58 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:58.485317 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-89dc8a70-6c1b-495b-afe9-32da49839baa tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:58.486059 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-89dc8a70-6c1b-495b-afe9-32da49839baa tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:58.495541 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89dc8a70-6c1b-495b-afe9-32da49839baa tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:58.496292 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89dc8a70-6c1b-495b-afe9-32da49839baa tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:58.496955 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89dc8a70-6c1b-495b-afe9-32da49839baa tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:58.498048 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89dc8a70-6c1b-495b-afe9-32da49839baa tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:58.498792 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89dc8a70-6c1b-495b-afe9-32da49839baa tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:58.499431 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89dc8a70-6c1b-495b-afe9-32da49839baa tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:58.686417 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-89dc8a70-6c1b-495b-afe9-32da49839baa tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:58.695105 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-89dc8a70-6c1b-495b-afe9-32da49839baa tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1682 microversion: 2.1 time: 0.213845 Aug 22 17:33:58.695762 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 328/654] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:58 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1682 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:59.370538 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-7dc008ca-bf8b-4390-9eea-5bfb539a3db1 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:59.371252 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-7dc008ca-bf8b-4390-9eea-5bfb539a3db1 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:59.378686 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7dc008ca-bf8b-4390-9eea-5bfb539a3db1 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:59.379183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7dc008ca-bf8b-4390-9eea-5bfb539a3db1 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:59.379616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7dc008ca-bf8b-4390-9eea-5bfb539a3db1 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:59.380470 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7dc008ca-bf8b-4390-9eea-5bfb539a3db1 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:59.380942 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7dc008ca-bf8b-4390-9eea-5bfb539a3db1 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:59.381351 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7dc008ca-bf8b-4390-9eea-5bfb539a3db1 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:59.555635 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7dc008ca-bf8b-4390-9eea-5bfb539a3db1 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:59.565360 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-7dc008ca-bf8b-4390-9eea-5bfb539a3db1 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1315 microversion: 2.1 time: 0.200992 Aug 22 17:33:59.566021 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 327/655] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:59 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:33:59.718006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ff3c1a68-7661-4f8d-a3d1-4cbec724e914 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:33:59.718736 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ff3c1a68-7661-4f8d-a3d1-4cbec724e914 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:33:59.721789 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:59.722560 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=6 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:33:59.731608 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff3c1a68-7661-4f8d-a3d1-4cbec724e914 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:59.737213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff3c1a68-7661-4f8d-a3d1-4cbec724e914 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:59.737213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff3c1a68-7661-4f8d-a3d1-4cbec724e914 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:59.737213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff3c1a68-7661-4f8d-a3d1-4cbec724e914 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:33:59.737213 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff3c1a68-7661-4f8d-a3d1-4cbec724e914 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:33:59.737796 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff3c1a68-7661-4f8d-a3d1-4cbec724e914 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:33:59.898412 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ff3c1a68-7661-4f8d-a3d1-4cbec724e914 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:33:59.907509 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ff3c1a68-7661-4f8d-a3d1-4cbec724e914 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1682 microversion: 2.1 time: 0.194283 Aug 22 17:33:59.908108 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 329/656] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:33:59 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1682 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:00.587198 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e0bedfca-477a-4660-949b-85e4ceeb5072 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:00.588102 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e0bedfca-477a-4660-949b-85e4ceeb5072 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:00.589887 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:00.595562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e0bedfca-477a-4660-949b-85e4ceeb5072 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:00.596064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e0bedfca-477a-4660-949b-85e4ceeb5072 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:00.596502 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e0bedfca-477a-4660-949b-85e4ceeb5072 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:00.597208 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e0bedfca-477a-4660-949b-85e4ceeb5072 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:00.597662 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e0bedfca-477a-4660-949b-85e4ceeb5072 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:00.598085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e0bedfca-477a-4660-949b-85e4ceeb5072 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:00.776300 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e0bedfca-477a-4660-949b-85e4ceeb5072 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:00.784957 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e0bedfca-477a-4660-949b-85e4ceeb5072 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1315 microversion: 2.1 time: 0.201638 Aug 22 17:34:00.785846 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 328/657] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:00 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:34:00.930143 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-893c28f3-1cfd-4c08-8dd2-1f4cee8cf6d6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:00.930763 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-893c28f3-1cfd-4c08-8dd2-1f4cee8cf6d6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:00.938075 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-893c28f3-1cfd-4c08-8dd2-1f4cee8cf6d6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:00.938613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-893c28f3-1cfd-4c08-8dd2-1f4cee8cf6d6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:00.939051 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-893c28f3-1cfd-4c08-8dd2-1f4cee8cf6d6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:00.939769 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-893c28f3-1cfd-4c08-8dd2-1f4cee8cf6d6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:00.940215 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-893c28f3-1cfd-4c08-8dd2-1f4cee8cf6d6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:00.940645 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-893c28f3-1cfd-4c08-8dd2-1f4cee8cf6d6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:01.188576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-893c28f3-1cfd-4c08-8dd2-1f4cee8cf6d6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:01.199596 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-893c28f3-1cfd-4c08-8dd2-1f4cee8cf6d6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1682 microversion: 2.1 time: 0.273089 Aug 22 17:34:01.200363 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 330/658] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:00 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1682 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:01.537206 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-7898b3a1-c74d-4ae5-96a1-05ff9075fd35 req-1b4c6998-b428-41f5-a916-ab88bcb943d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cbba4e2-1078-42e9-84bc-bf56057c460f", "name": "network-vif-plugged", "status": "completed", "tag": "697017a2-ce7c-439b-a23d-a8e637d991a4"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:01.548870 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-7898b3a1-c74d-4ae5-96a1-05ff9075fd35 req-1b4c6998-b428-41f5-a916-ab88bcb943d8 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:01.549490 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-7898b3a1-c74d-4ae5-96a1-05ff9075fd35 req-1b4c6998-b428-41f5-a916-ab88bcb943d8 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:01.549877 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-7898b3a1-c74d-4ae5-96a1-05ff9075fd35 req-1b4c6998-b428-41f5-a916-ab88bcb943d8 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:01.562628 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-7898b3a1-c74d-4ae5-96a1-05ff9075fd35 req-1b4c6998-b428-41f5-a916-ab88bcb943d8 service nova] Creating event network-vif-plugged:697017a2-ce7c-439b-a23d-a8e637d991a4 for instance 2cbba4e2-1078-42e9-84bc-bf56057c460f on hv-cinder-85394 Aug 22 17:34:01.568048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-7898b3a1-c74d-4ae5-96a1-05ff9075fd35 req-1b4c6998-b428-41f5-a916-ab88bcb943d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036047 Aug 22 17:34:01.568896 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 329/659] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:34:01.808515 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-1a2a21e0-bcf5-4cda-a530-fef3c198d08c tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:01.809133 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-1a2a21e0-bcf5-4cda-a530-fef3c198d08c tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:01.815811 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1a2a21e0-bcf5-4cda-a530-fef3c198d08c tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:01.816206 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1a2a21e0-bcf5-4cda-a530-fef3c198d08c tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:01.816644 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1a2a21e0-bcf5-4cda-a530-fef3c198d08c tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:01.817371 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1a2a21e0-bcf5-4cda-a530-fef3c198d08c tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:01.817825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1a2a21e0-bcf5-4cda-a530-fef3c198d08c tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:01.818416 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1a2a21e0-bcf5-4cda-a530-fef3c198d08c tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:02.093135 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-1a2a21e0-bcf5-4cda-a530-fef3c198d08c tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:02.104222 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-1a2a21e0-bcf5-4cda-a530-fef3c198d08c tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1315 microversion: 2.1 time: 0.299440 Aug 22 17:34:02.104838 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 331/660] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:01 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:02.236857 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6dd117b4-4fa0-4dab-a84f-39b6c54414a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:02.238561 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6dd117b4-4fa0-4dab-a84f-39b6c54414a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:02.249276 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6dd117b4-4fa0-4dab-a84f-39b6c54414a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:02.249416 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6dd117b4-4fa0-4dab-a84f-39b6c54414a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:02.251279 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6dd117b4-4fa0-4dab-a84f-39b6c54414a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:02.252430 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6dd117b4-4fa0-4dab-a84f-39b6c54414a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:02.253478 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6dd117b4-4fa0-4dab-a84f-39b6c54414a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:02.254322 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6dd117b4-4fa0-4dab-a84f-39b6c54414a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:02.394281 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6dd117b4-4fa0-4dab-a84f-39b6c54414a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:02.412427 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6dd117b4-4fa0-4dab-a84f-39b6c54414a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1614 microversion: 2.1 time: 0.181132 Aug 22 17:34:02.425392 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 330/661] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:02 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1614 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:02.579720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-2b419639-1b2c-4eff-ba9b-a5ab920c4a92 req-4b00766c-01c2-4d92-b7aa-80e381684735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3e55a36-fde4-47f6-bc2b-9ab85db48b7c", "name": "network-vif-deleted", "tag": "d88ca234-5410-4926-9330-534af21259ea"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:02.603203 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-2b419639-1b2c-4eff-ba9b-a5ab920c4a92 req-4b00766c-01c2-4d92-b7aa-80e381684735 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:02.603918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-2b419639-1b2c-4eff-ba9b-a5ab920c4a92 req-4b00766c-01c2-4d92-b7aa-80e381684735 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:02.604359 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-2b419639-1b2c-4eff-ba9b-a5ab920c4a92 req-4b00766c-01c2-4d92-b7aa-80e381684735 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:02.617722 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-2b419639-1b2c-4eff-ba9b-a5ab920c4a92 req-4b00766c-01c2-4d92-b7aa-80e381684735 service nova] Creating event network-vif-deleted:d88ca234-5410-4926-9330-534af21259ea for instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c on hv-cinder-85394 Aug 22 17:34:02.628932 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-2b419639-1b2c-4eff-ba9b-a5ab920c4a92 req-4b00766c-01c2-4d92-b7aa-80e381684735 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053070 Aug 22 17:34:02.630093 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 332/662] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:34:03.136389 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d14f7761-bebb-423e-baa0-d686009945f6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:03.138360 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d14f7761-bebb-423e-baa0-d686009945f6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:03.149627 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d14f7761-bebb-423e-baa0-d686009945f6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:03.152409 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d14f7761-bebb-423e-baa0-d686009945f6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:03.153495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d14f7761-bebb-423e-baa0-d686009945f6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:03.155024 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d14f7761-bebb-423e-baa0-d686009945f6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:03.156057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d14f7761-bebb-423e-baa0-d686009945f6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:03.157200 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d14f7761-bebb-423e-baa0-d686009945f6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:03.376411 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d14f7761-bebb-423e-baa0-d686009945f6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:03.391550 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d14f7761-bebb-423e-baa0-d686009945f6 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1315 microversion: 2.1 time: 0.261795 Aug 22 17:34:03.397692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 331/663] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:03 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:03.451439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b07fca57-f67a-4f32-9fad-9450a9eed083 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:03.453688 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b07fca57-f67a-4f32-9fad-9450a9eed083 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:03.466779 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b07fca57-f67a-4f32-9fad-9450a9eed083 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:03.467264 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b07fca57-f67a-4f32-9fad-9450a9eed083 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:03.468200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b07fca57-f67a-4f32-9fad-9450a9eed083 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:03.469359 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b07fca57-f67a-4f32-9fad-9450a9eed083 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:03.470153 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b07fca57-f67a-4f32-9fad-9450a9eed083 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:03.470942 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b07fca57-f67a-4f32-9fad-9450a9eed083 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:03.601568 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b07fca57-f67a-4f32-9fad-9450a9eed083 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:03.622578 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b07fca57-f67a-4f32-9fad-9450a9eed083 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1326 microversion: 2.1 time: 0.178998 Aug 22 17:34:03.640561 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 333/664] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:03 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1326 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:04.425793 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b9adb37b-c91f-4b61-96b2-6a0c36dbad25 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:04.427296 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b9adb37b-c91f-4b61-96b2-6a0c36dbad25 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:04.439066 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b9adb37b-c91f-4b61-96b2-6a0c36dbad25 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:04.439839 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b9adb37b-c91f-4b61-96b2-6a0c36dbad25 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:04.440455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b9adb37b-c91f-4b61-96b2-6a0c36dbad25 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:04.441654 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b9adb37b-c91f-4b61-96b2-6a0c36dbad25 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:04.442341 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b9adb37b-c91f-4b61-96b2-6a0c36dbad25 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:04.443216 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b9adb37b-c91f-4b61-96b2-6a0c36dbad25 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:04.631927 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b9adb37b-c91f-4b61-96b2-6a0c36dbad25 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:04.647709 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b9adb37b-c91f-4b61-96b2-6a0c36dbad25 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1465 microversion: 2.1 time: 0.228535 Aug 22 17:34:04.648767 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 332/665] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:04 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1465 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:04.674649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-11b269ef-ef8b-4b9e-9eae-b056992ecc8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:04.677920 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-11b269ef-ef8b-4b9e-9eae-b056992ecc8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:04.691220 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11b269ef-ef8b-4b9e-9eae-b056992ecc8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:04.692049 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11b269ef-ef8b-4b9e-9eae-b056992ecc8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:04.692994 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11b269ef-ef8b-4b9e-9eae-b056992ecc8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:04.694233 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11b269ef-ef8b-4b9e-9eae-b056992ecc8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:04.695320 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11b269ef-ef8b-4b9e-9eae-b056992ecc8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:04.696151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11b269ef-ef8b-4b9e-9eae-b056992ecc8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:04.734453 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-3163c209-d367-4da3-b6c7-00ecd59cce91 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:04.736537 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-3163c209-d367-4da3-b6c7-00ecd59cce91 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:04.750813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3163c209-d367-4da3-b6c7-00ecd59cce91 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:04.752517 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3163c209-d367-4da3-b6c7-00ecd59cce91 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:04.753639 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3163c209-d367-4da3-b6c7-00ecd59cce91 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:04.756558 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3163c209-d367-4da3-b6c7-00ecd59cce91 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:04.758095 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3163c209-d367-4da3-b6c7-00ecd59cce91 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:04.760438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3163c209-d367-4da3-b6c7-00ecd59cce91 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:04.781997 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11b269ef-ef8b-4b9e-9eae-b056992ecc8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:04.782386 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11b269ef-ef8b-4b9e-9eae-b056992ecc8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:04.783127 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11b269ef-ef8b-4b9e-9eae-b056992ecc8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:04.783756 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-11b269ef-ef8b-4b9e-9eae-b056992ecc8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lazy-loading 'fault' on Instance uuid d3e55a36-fde4-47f6-bc2b-9ab85db48b7c {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:34:04.819728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-3163c209-d367-4da3-b6c7-00ecd59cce91 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Going to try to terminate instance {{(pid=121853) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:34:04.825689 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:04.852744 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-11b269ef-ef8b-4b9e-9eae-b056992ecc8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:04.862225 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-11b269ef-ef8b-4b9e-9eae-b056992ecc8b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 200 len: 1331 microversion: 2.1 time: 0.197322 Aug 22 17:34:04.862880 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 334/666] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:04 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 1331 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:05.341497 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-3163c209-d367-4da3-b6c7-00ecd59cce91 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 204 len: 0 microversion: 2.1 time: 0.615871 Aug 22 17:34:05.342377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 333/667] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:34:04 2022] DELETE /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 0 bytes in 618 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:34:05.351563 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d14d2eb6-8ef3-4a7b-b6a7-33531b0634ed tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:05.352280 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d14d2eb6-8ef3-4a7b-b6a7-33531b0634ed tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:05.359580 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d14d2eb6-8ef3-4a7b-b6a7-33531b0634ed tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:05.360040 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d14d2eb6-8ef3-4a7b-b6a7-33531b0634ed tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:05.360482 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d14d2eb6-8ef3-4a7b-b6a7-33531b0634ed tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:05.361260 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d14d2eb6-8ef3-4a7b-b6a7-33531b0634ed tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:05.361726 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d14d2eb6-8ef3-4a7b-b6a7-33531b0634ed tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:05.362159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d14d2eb6-8ef3-4a7b-b6a7-33531b0634ed tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:05.530010 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-d14d2eb6-8ef3-4a7b-b6a7-33531b0634ed tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:05.539515 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d14d2eb6-8ef3-4a7b-b6a7-33531b0634ed tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1471 microversion: 2.1 time: 0.192194 Aug 22 17:34:05.540260 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 335/668] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:05 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1471 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:34:05.888690 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f1b76e6c-ed9e-4270-9198-0d1c3098b0e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:05.889501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f1b76e6c-ed9e-4270-9198-0d1c3098b0e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:05.896490 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f1b76e6c-ed9e-4270-9198-0d1c3098b0e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:05.896980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f1b76e6c-ed9e-4270-9198-0d1c3098b0e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:05.897414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f1b76e6c-ed9e-4270-9198-0d1c3098b0e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:05.898178 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f1b76e6c-ed9e-4270-9198-0d1c3098b0e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:05.898662 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f1b76e6c-ed9e-4270-9198-0d1c3098b0e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:05.899081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f1b76e6c-ed9e-4270-9198-0d1c3098b0e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:05.915477 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-f1b76e6c-ed9e-4270-9198-0d1c3098b0e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] HTTP exception thrown: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f1b76e6c-ed9e-4270-9198-0d1c3098b0e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Request method failure captured: Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c HTTP/1.1 Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA7xLFyP3sazpo8lNxFPukerJWviDoPTaEBmzGGnNT2hK_WSNwW1QEyJSvA7cujhX4n3KzSw_ywGF8KgQMwv_P1bklerqKHJCnSQNmsRxQWmDXBuOt_ZETYxuWcB2qstyCMegdrnu-rvFjhw-dLXTo-dX3Y3VP9AGooFNTG8HqCGsto4 Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:34:05.917692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:34:05.920218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6436020e938047408d1f979e23dd48da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6436020e938047408d1f979e23dd48da", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:34:05.920218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:34:05.920218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:34:05.920218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:34:05.920218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:34:05.920218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:34:05.920218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:34:05.920218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: b0db362075b04b2294a6268576a5bba3 Aug 22 17:34:05.920218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:34:05.920218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:34:05.920218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:34:05.920218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': 'd3e55a36-fde4-47f6-bc2b-9ab85db48b7c'} Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:34:05.921915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:34:05.924602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:05.926937 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f1b76e6c-ed9e-4270-9198-0d1c3098b0e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Returning 404 to user: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:34:05.926937 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f1b76e6c-ed9e-4270-9198-0d1c3098b0e1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 404 len: 111 microversion: 2.1 time: 0.036067 Aug 22 17:34:05.926937 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 334/669] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:05 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:34:05.930832 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-fe303939-667a-4598-86d9-994e7c136ecc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '.version_select at 0x7f0e60ee9ee0>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:06.048599 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-fe303939-667a-4598-86d9-994e7c136ecc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-325505628" status: 202 len: 0 microversion: 2.1 time: 0.121533 Aug 22 17:34:06.049106 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 336/670] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 22 17:34:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-325505628 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:34:06.579083 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-7eca6b76-e07a-41f6-b247-3ffb18bd4942 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:06.580288 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-7eca6b76-e07a-41f6-b247-3ffb18bd4942 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:06.590095 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7eca6b76-e07a-41f6-b247-3ffb18bd4942 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:06.590744 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7eca6b76-e07a-41f6-b247-3ffb18bd4942 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:06.591320 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7eca6b76-e07a-41f6-b247-3ffb18bd4942 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:06.593263 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7eca6b76-e07a-41f6-b247-3ffb18bd4942 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:06.595033 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7eca6b76-e07a-41f6-b247-3ffb18bd4942 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:06.596335 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7eca6b76-e07a-41f6-b247-3ffb18bd4942 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:06.805847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7eca6b76-e07a-41f6-b247-3ffb18bd4942 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:06.817342 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-7eca6b76-e07a-41f6-b247-3ffb18bd4942 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1471 microversion: 2.1 time: 0.256356 Aug 22 17:34:06.818587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 335/671] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:06 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1471 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:07.169860 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9ae138aa-3b4a-4d61-89e0-d4c7c8b5a2b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:07.170733 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9ae138aa-3b4a-4d61-89e0-d4c7c8b5a2b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:07.182402 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9ae138aa-3b4a-4d61-89e0-d4c7c8b5a2b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:07.183324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9ae138aa-3b4a-4d61-89e0-d4c7c8b5a2b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:07.184090 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9ae138aa-3b4a-4d61-89e0-d4c7c8b5a2b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:07.185333 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9ae138aa-3b4a-4d61-89e0-d4c7c8b5a2b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:07.186142 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9ae138aa-3b4a-4d61-89e0-d4c7c8b5a2b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:07.186943 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9ae138aa-3b4a-4d61-89e0-d4c7c8b5a2b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:07.333720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-9ae138aa-3b4a-4d61-89e0-d4c7c8b5a2b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lazy-loading 'services' on Instance uuid e1c1f97f-c673-4f7b-8ecf-45396ce57516 {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:34:07.639623 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9ae138aa-3b4a-4d61-89e0-d4c7c8b5a2b4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516/os-volume_attachments/4892817e-866b-4e98-b1aa-ecdca6121d4d" status: 202 len: 0 microversion: 2.1 time: 0.478004 Aug 22 17:34:07.640535 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 337/672] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 22 17:34:07 2022] DELETE /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516/os-volume_attachments/4892817e-866b-4e98-b1aa-ecdca6121d4d => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:34:07.652603 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a6b2d3b3-3f54-43ec-b92c-8cbe48f5150c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:07.656758 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a6b2d3b3-3f54-43ec-b92c-8cbe48f5150c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:07.667813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6b2d3b3-3f54-43ec-b92c-8cbe48f5150c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:07.668383 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6b2d3b3-3f54-43ec-b92c-8cbe48f5150c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:07.670454 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6b2d3b3-3f54-43ec-b92c-8cbe48f5150c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:07.670454 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6b2d3b3-3f54-43ec-b92c-8cbe48f5150c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:07.670795 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6b2d3b3-3f54-43ec-b92c-8cbe48f5150c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:07.671388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6b2d3b3-3f54-43ec-b92c-8cbe48f5150c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:07.706074 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a6b2d3b3-3f54-43ec-b92c-8cbe48f5150c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059692 Aug 22 17:34:07.709290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 336/673] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:34:07 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:34:07.879904 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6ebb1e8b-5b37-4eb8-898a-72f8cd3791d8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:07.883323 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6ebb1e8b-5b37-4eb8-898a-72f8cd3791d8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:07.917423 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6ebb1e8b-5b37-4eb8-898a-72f8cd3791d8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:07.919504 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6ebb1e8b-5b37-4eb8-898a-72f8cd3791d8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:07.920078 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6ebb1e8b-5b37-4eb8-898a-72f8cd3791d8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:07.922700 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6ebb1e8b-5b37-4eb8-898a-72f8cd3791d8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:07.922700 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6ebb1e8b-5b37-4eb8-898a-72f8cd3791d8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:07.924019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6ebb1e8b-5b37-4eb8-898a-72f8cd3791d8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:07.930186 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:07.985823 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-e39ebddd-1905-4a33-b1f6-3edfe7bc6f1d req-59b8dc02-5f5a-4006-82b7-2a10271771d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cbba4e2-1078-42e9-84bc-bf56057c460f", "name": "network-vif-deleted", "tag": "697017a2-ce7c-439b-a23d-a8e637d991a4"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:07.996810 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-e39ebddd-1905-4a33-b1f6-3edfe7bc6f1d req-59b8dc02-5f5a-4006-82b7-2a10271771d8 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:07.997746 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-e39ebddd-1905-4a33-b1f6-3edfe7bc6f1d req-59b8dc02-5f5a-4006-82b7-2a10271771d8 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:07.998349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-e39ebddd-1905-4a33-b1f6-3edfe7bc6f1d req-59b8dc02-5f5a-4006-82b7-2a10271771d8 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:08.013505 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-e39ebddd-1905-4a33-b1f6-3edfe7bc6f1d req-59b8dc02-5f5a-4006-82b7-2a10271771d8 service nova] Creating event network-vif-deleted:697017a2-ce7c-439b-a23d-a8e637d991a4 for instance 2cbba4e2-1078-42e9-84bc-bf56057c460f on hv-cinder-85394 Aug 22 17:34:08.021120 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6ebb1e8b-5b37-4eb8-898a-72f8cd3791d8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:08.021453 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-e39ebddd-1905-4a33-b1f6-3edfe7bc6f1d req-59b8dc02-5f5a-4006-82b7-2a10271771d8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038745 Aug 22 17:34:08.022231 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 337/674] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:34:08.032046 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6ebb1e8b-5b37-4eb8-898a-72f8cd3791d8 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1429 microversion: 2.1 time: 0.184181 Aug 22 17:34:08.032894 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 338/675] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:07 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1429 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:08.721164 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-05c2cad8-76a4-4c89-9b7b-49f99ee3e952 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:08.724097 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-05c2cad8-76a4-4c89-9b7b-49f99ee3e952 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:08.731721 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-05c2cad8-76a4-4c89-9b7b-49f99ee3e952 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:08.737304 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-05c2cad8-76a4-4c89-9b7b-49f99ee3e952 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:08.737304 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-05c2cad8-76a4-4c89-9b7b-49f99ee3e952 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:08.737304 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-05c2cad8-76a4-4c89-9b7b-49f99ee3e952 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:08.737304 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-05c2cad8-76a4-4c89-9b7b-49f99ee3e952 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:08.737897 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-05c2cad8-76a4-4c89-9b7b-49f99ee3e952 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:08.770045 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-05c2cad8-76a4-4c89-9b7b-49f99ee3e952 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053846 Aug 22 17:34:08.770653 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 338/676] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:34:08 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:34:09.059561 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c0c623dc-4883-447f-9303-38d0b2b2b9c2 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:09.060313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c0c623dc-4883-447f-9303-38d0b2b2b9c2 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:09.068113 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c0c623dc-4883-447f-9303-38d0b2b2b9c2 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:09.068783 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c0c623dc-4883-447f-9303-38d0b2b2b9c2 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:09.069347 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c0c623dc-4883-447f-9303-38d0b2b2b9c2 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:09.070120 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c0c623dc-4883-447f-9303-38d0b2b2b9c2 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:09.070773 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c0c623dc-4883-447f-9303-38d0b2b2b9c2 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:09.071313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c0c623dc-4883-447f-9303-38d0b2b2b9c2 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:09.109053 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c0c623dc-4883-447f-9303-38d0b2b2b9c2 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:09.109564 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c0c623dc-4883-447f-9303-38d0b2b2b9c2 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:09.110066 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c0c623dc-4883-447f-9303-38d0b2b2b9c2 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:09.110438 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-c0c623dc-4883-447f-9303-38d0b2b2b9c2 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lazy-loading 'fault' on Instance uuid 2cbba4e2-1078-42e9-84bc-bf56057c460f {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:34:09.169783 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c0c623dc-4883-447f-9303-38d0b2b2b9c2 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '59d328d707b7409288cd118aecd6af54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '956e52f3b5824c6b8d473ae0fef859c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:09.180712 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c0c623dc-4883-447f-9303-38d0b2b2b9c2 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 200 len: 1305 microversion: 2.1 time: 0.126614 Aug 22 17:34:09.181487 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 339/677] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:09 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 1305 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:09.784753 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cfb2f42d-a350-4fb7-9a43-449c075f5c31 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:09.789540 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-cfb2f42d-a350-4fb7-9a43-449c075f5c31 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:09.794364 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cfb2f42d-a350-4fb7-9a43-449c075f5c31 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:09.794888 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cfb2f42d-a350-4fb7-9a43-449c075f5c31 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:09.795328 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cfb2f42d-a350-4fb7-9a43-449c075f5c31 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:09.796048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cfb2f42d-a350-4fb7-9a43-449c075f5c31 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:09.796500 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cfb2f42d-a350-4fb7-9a43-449c075f5c31 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:09.796950 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cfb2f42d-a350-4fb7-9a43-449c075f5c31 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:09.830695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-cfb2f42d-a350-4fb7-9a43-449c075f5c31 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050570 Aug 22 17:34:09.831321 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 339/678] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:34:09 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 17:34:09.929556 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d33985e2-a962-4333-822f-eb5590c3a384 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:09.930070 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d33985e2-a962-4333-822f-eb5590c3a384 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:09.937359 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d33985e2-a962-4333-822f-eb5590c3a384 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:09.937856 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d33985e2-a962-4333-822f-eb5590c3a384 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:09.938296 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d33985e2-a962-4333-822f-eb5590c3a384 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:09.939060 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d33985e2-a962-4333-822f-eb5590c3a384 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:09.939562 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d33985e2-a962-4333-822f-eb5590c3a384 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:09.939982 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d33985e2-a962-4333-822f-eb5590c3a384 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:09.969163 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d33985e2-a962-4333-822f-eb5590c3a384 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Going to try to terminate instance {{(pid=121852) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:34:10.205813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ccdab177-2957-4f2e-9ae4-4e83ea751f30 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:10.206437 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ccdab177-2957-4f2e-9ae4-4e83ea751f30 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] [instance: 2cbba4e2-1078-42e9-84bc-bf56057c460f] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:10.213703 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ccdab177-2957-4f2e-9ae4-4e83ea751f30 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:10.219371 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ccdab177-2957-4f2e-9ae4-4e83ea751f30 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:10.219371 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ccdab177-2957-4f2e-9ae4-4e83ea751f30 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:10.219371 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ccdab177-2957-4f2e-9ae4-4e83ea751f30 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:10.219371 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ccdab177-2957-4f2e-9ae4-4e83ea751f30 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:10.220001 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ccdab177-2957-4f2e-9ae4-4e83ea751f30 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:10.232866 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-ccdab177-2957-4f2e-9ae4-4e83ea751f30 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] HTTP exception thrown: Instance 2cbba4e2-1078-42e9-84bc-bf56057c460f could not be found. Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ccdab177-2957-4f2e-9ae4-4e83ea751f30 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Request method failure captured: Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f HTTP/1.1 Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA736MLL4_lC8Qmwfy3ySe2yQLLW2SL-2dpFFpE0IMNXOFT0n12y5JDVmDxtW_Zlo-_4yZ6u_jzTrme9h0UZS2qAD6WpJALeDw057_kk-7ptm_SI-WEmgFyHd6vpOemUU6bm6kvNvGWZgXWrrEfCIwbIvVR010ib3Cr-FsPKCG5jL0lU Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 956e52f3b5824c6b8d473ae0fef859c4 Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-VolumesNegativeTest-585742979 Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:34:10.234587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:34:10.237085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/956e52f3b5824c6b8d473ae0fef859c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/956e52f3b5824c6b8d473ae0fef859c4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/956e52f3b5824c6b8d473ae0fef859c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_956e52f3b5824c6b8d473ae0fef859c4", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:34:10.237085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-VolumesNegativeTest-585742979 Aug 22 17:34:10.237085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 956e52f3b5824c6b8d473ae0fef859c4 Aug 22 17:34:10.237085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-VolumesNegativeTest-585742979 Aug 22 17:34:10.237085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-VolumesNegativeTest-585742979-project Aug 22 17:34:10.237085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:34:10.237085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:34:10.237085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: 59d328d707b7409288cd118aecd6af54 Aug 22 17:34:10.237085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-VolumesNegativeTest-585742979-project Aug 22 17:34:10.237085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:34:10.237085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance 2cbba4e2-1078-42e9-84bc-bf56057c460f could not be found. Aug 22 17:34:10.237085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': '2cbba4e2-1078-42e9-84bc-bf56057c460f'} Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cbba4e2-1078-42e9-84bc-bf56057c460f could not be found. Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:34:10.238759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cbba4e2-1078-42e9-84bc-bf56057c460f could not be found. Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cbba4e2-1078-42e9-84bc-bf56057c460f could not be found. Aug 22 17:34:10.241106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:10.243788 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ccdab177-2957-4f2e-9ae4-4e83ea751f30 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] Returning 404 to user: Instance 2cbba4e2-1078-42e9-84bc-bf56057c460f could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:34:10.243788 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ccdab177-2957-4f2e-9ae4-4e83ea751f30 tempest-VolumesNegativeTest-585742979 tempest-VolumesNegativeTest-585742979-project] 10.222.0.20 "GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f" status: 404 len: 111 microversion: 2.1 time: 0.034444 Aug 22 17:34:10.243788 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 340/679] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:10 2022] GET /compute/v2.1/servers/2cbba4e2-1078-42e9-84bc-bf56057c460f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:34:10.438830 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d33985e2-a962-4333-822f-eb5590c3a384 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 204 len: 0 microversion: 2.1 time: 0.512751 Aug 22 17:34:10.439654 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 340/680] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:34:09 2022] DELETE /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:34:10.450740 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-12505cb7-6a4a-4f58-aa6a-47167bc78992 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:10.451548 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-12505cb7-6a4a-4f58-aa6a-47167bc78992 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:10.459185 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-12505cb7-6a4a-4f58-aa6a-47167bc78992 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:10.460011 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-12505cb7-6a4a-4f58-aa6a-47167bc78992 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:10.460447 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-12505cb7-6a4a-4f58-aa6a-47167bc78992 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:10.461214 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-12505cb7-6a4a-4f58-aa6a-47167bc78992 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:10.461598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-12505cb7-6a4a-4f58-aa6a-47167bc78992 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:10.462024 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-12505cb7-6a4a-4f58-aa6a-47167bc78992 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:10.649852 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-12505cb7-6a4a-4f58-aa6a-47167bc78992 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:10.666988 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-12505cb7-6a4a-4f58-aa6a-47167bc78992 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1679 microversion: 2.1 time: 0.221530 Aug 22 17:34:10.668362 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 341/681] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:10 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1679 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:34:11.702666 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-1b3d639c-e810-4b66-8092-707e38452fb3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:11.704075 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-1b3d639c-e810-4b66-8092-707e38452fb3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:11.739992 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1b3d639c-e810-4b66-8092-707e38452fb3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:11.739992 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1b3d639c-e810-4b66-8092-707e38452fb3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:11.739992 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1b3d639c-e810-4b66-8092-707e38452fb3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:11.739992 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1b3d639c-e810-4b66-8092-707e38452fb3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:11.740938 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1b3d639c-e810-4b66-8092-707e38452fb3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:11.740938 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1b3d639c-e810-4b66-8092-707e38452fb3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:12.049537 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-1b3d639c-e810-4b66-8092-707e38452fb3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:12.067583 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-1b3d639c-e810-4b66-8092-707e38452fb3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1679 microversion: 2.1 time: 0.374293 Aug 22 17:34:12.069497 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 341/682] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:11 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1679 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:12.721115 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-25217c99-a8fb-46dd-ba8d-4dab70a39906 req-896902e4-9bc3-4256-97d6-e8a1a0d31d98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c1f97f-c673-4f7b-8ecf-45396ce57516", "name": "network-vif-deleted", "tag": "acf48248-cd4c-42ff-9f56-03f04156294f"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:12.739105 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:12.750936 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-25217c99-a8fb-46dd-ba8d-4dab70a39906 req-896902e4-9bc3-4256-97d6-e8a1a0d31d98 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:12.752118 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-25217c99-a8fb-46dd-ba8d-4dab70a39906 req-896902e4-9bc3-4256-97d6-e8a1a0d31d98 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:12.753331 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-25217c99-a8fb-46dd-ba8d-4dab70a39906 req-896902e4-9bc3-4256-97d6-e8a1a0d31d98 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:12.775960 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-25217c99-a8fb-46dd-ba8d-4dab70a39906 req-896902e4-9bc3-4256-97d6-e8a1a0d31d98 service nova] Creating event network-vif-deleted:acf48248-cd4c-42ff-9f56-03f04156294f for instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 on hv-cinder-85394 Aug 22 17:34:12.783066 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-25217c99-a8fb-46dd-ba8d-4dab70a39906 req-896902e4-9bc3-4256-97d6-e8a1a0d31d98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076822 Aug 22 17:34:12.783807 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 342/683] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:34:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:34:13.111379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-adc8bed2-d637-4fbb-b2ad-3f9d42e49abb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:13.112769 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-adc8bed2-d637-4fbb-b2ad-3f9d42e49abb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:13.136706 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-adc8bed2-d637-4fbb-b2ad-3f9d42e49abb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:13.137566 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-adc8bed2-d637-4fbb-b2ad-3f9d42e49abb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:13.138602 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-adc8bed2-d637-4fbb-b2ad-3f9d42e49abb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:13.139558 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-adc8bed2-d637-4fbb-b2ad-3f9d42e49abb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:13.140286 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-adc8bed2-d637-4fbb-b2ad-3f9d42e49abb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:13.141234 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-adc8bed2-d637-4fbb-b2ad-3f9d42e49abb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:13.185001 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-adc8bed2-d637-4fbb-b2ad-3f9d42e49abb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:13.185493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-adc8bed2-d637-4fbb-b2ad-3f9d42e49abb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:13.185930 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-adc8bed2-d637-4fbb-b2ad-3f9d42e49abb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:13.186382 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-adc8bed2-d637-4fbb-b2ad-3f9d42e49abb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lazy-loading 'fault' on Instance uuid e1c1f97f-c673-4f7b-8ecf-45396ce57516 {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:34:13.254475 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-adc8bed2-d637-4fbb-b2ad-3f9d42e49abb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:13.269514 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-adc8bed2-d637-4fbb-b2ad-3f9d42e49abb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 200 len: 1331 microversion: 2.1 time: 0.166687 Aug 22 17:34:13.270628 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 342/684] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:13 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 1331 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:14.314249 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5f73cdcc-d50f-43bb-bc1a-1251f5ed153d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:14.315573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5f73cdcc-d50f-43bb-bc1a-1251f5ed153d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:14.330214 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5f73cdcc-d50f-43bb-bc1a-1251f5ed153d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:14.345146 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5f73cdcc-d50f-43bb-bc1a-1251f5ed153d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:14.345146 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5f73cdcc-d50f-43bb-bc1a-1251f5ed153d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:14.345146 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5f73cdcc-d50f-43bb-bc1a-1251f5ed153d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:14.345146 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5f73cdcc-d50f-43bb-bc1a-1251f5ed153d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:14.345802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5f73cdcc-d50f-43bb-bc1a-1251f5ed153d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:14.355759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-5f73cdcc-d50f-43bb-bc1a-1251f5ed153d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] HTTP exception thrown: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5f73cdcc-d50f-43bb-bc1a-1251f5ed153d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Request method failure captured: Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 HTTP/1.1 Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA7xLFyP3sazpo8lNxFPukerJWviDoPTaEBmzGGnNT2hK_WSNwW1QEyJSvA7cujhX4n3KzSw_ywGF8KgQMwv_P1bklerqKHJCnSQNmsRxQWmDXBuOt_ZETYxuWcB2qstyCMegdrnu-rvFjhw-dLXTo-dX3Y3VP9AGooFNTG8HqCGsto4 Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:34:14.357468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:34:14.360443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6436020e938047408d1f979e23dd48da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6436020e938047408d1f979e23dd48da", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:34:14.360443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:34:14.360443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:34:14.360443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:34:14.360443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:34:14.360443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:34:14.360443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:34:14.360443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: b0db362075b04b2294a6268576a5bba3 Aug 22 17:34:14.360443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:34:14.360443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:34:14.360443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:34:14.360443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': 'e1c1f97f-c673-4f7b-8ecf-45396ce57516'} Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:34:14.362332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:34:14.365235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:34:14.367479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5f73cdcc-d50f-43bb-bc1a-1251f5ed153d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Returning 404 to user: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:34:14.367479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5f73cdcc-d50f-43bb-bc1a-1251f5ed153d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 404 len: 111 microversion: 2.1 time: 0.050719 Aug 22 17:34:14.367479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 343/685] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:14 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:34:14.385434 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c10dcbb6-ef06-4ae5-b5dc-88ad63b89281 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '.version_select at 0x7f0e60ef75e0>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:14.520488 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c10dcbb6-ef06-4ae5-b5dc-88ad63b89281 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-760883869" status: 202 len: 0 microversion: 2.1 time: 0.153317 Aug 22 17:34:14.522065 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 343/686] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 22 17:34:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-760883869 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:34:16.052004 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-65be9f50-3818-41b8-af81-bf97cb1aa5b9 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Action: 'create', calling method: .version_select at 0x7f0e5c661ca0>, body: {"keypair": {"name": "tempest-keypair-248505279", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEqneNWAbPdgJjnEcLFXWnR7TKmz4nEfLINZlL/2jKdwN6gt3eE9KDNNqJ9UUCajiebJ43gDbtcfre+yjRObtDBwH1WVnRlyvmOWUiNAgXLtNZg5SrSLz6muiEjxdKhIRg=="}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:16.081683 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-65be9f50-3818-41b8-af81-bf97cb1aa5b9 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for project 6436020e938047408d1f979e23dd48da. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:34:16.089084 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-65be9f50-3818-41b8-af81-bf97cb1aa5b9 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for user b0db362075b04b2294a6268576a5bba3 and project 6436020e938047408d1f979e23dd48da. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:34:16.235088 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-65be9f50-3818-41b8-af81-bf97cb1aa5b9 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.190589 Aug 22 17:34:16.235703 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 344/687] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 22 17:34:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:34:19.136820 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1533718619", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab7e148b-b163-4e14-9626-bb3c240fc395"}], "security_groups": [{"name": "tempest-securitygroup--1612956284"}], "key_name": "tempest-keypair-248505279", "user_data": "}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:19.151928 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:19.291656 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.network.neutron [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] validate_networks() for [('ab7e148b-b163-4e14-9626-bb3c240fc395', None, None, None, None, None)] {{(pid=121852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:34:19.817398 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Flavor limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:34:19.817398 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Image limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:34:19.817398 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Flavor pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:34:19.817398 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Image pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:34:19.817398 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:34:19.825147 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:19.825653 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:19.826087 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:19.827037 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:19.827487 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:19.827910 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:19.846188 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for project 6436020e938047408d1f979e23dd48da. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:34:19.850174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for user b0db362075b04b2294a6268576a5bba3 and project 6436020e938047408d1f979e23dd48da. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:34:19.865024 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Going to run 1 instances... {{(pid=121852) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:34:19.867574 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:34:20.031340 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-af150b50-d59f-4a4a-a73f-991423a7ea2f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.903018 Aug 22 17:34:20.032492 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 344/688] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:34:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 905 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:34:20.045493 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-bb36f129-f6d2-4233-8038-245bd26ddcac tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:20.046356 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-bb36f129-f6d2-4233-8038-245bd26ddcac tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:20.126688 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-bb36f129-f6d2-4233-8038-245bd26ddcac tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:20.134820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-bb36f129-f6d2-4233-8038-245bd26ddcac tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1241 microversion: 2.1 time: 0.094173 Aug 22 17:34:20.135499 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 345/689] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:20 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1241 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:34:21.175672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-eaeabf7e-5ade-40bd-987a-560de35a383d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:21.176897 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-eaeabf7e-5ade-40bd-987a-560de35a383d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:21.256471 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-eaeabf7e-5ade-40bd-987a-560de35a383d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:21.266659 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-eaeabf7e-5ade-40bd-987a-560de35a383d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1241 microversion: 2.1 time: 0.098989 Aug 22 17:34:21.267441 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 345/690] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:21 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:22.290600 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a6288d33-b0da-4232-85e5-1b7728374356 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:22.291451 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a6288d33-b0da-4232-85e5-1b7728374356 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:22.298501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6288d33-b0da-4232-85e5-1b7728374356 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:22.299153 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6288d33-b0da-4232-85e5-1b7728374356 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:22.299935 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6288d33-b0da-4232-85e5-1b7728374356 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:22.300767 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6288d33-b0da-4232-85e5-1b7728374356 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:22.301387 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6288d33-b0da-4232-85e5-1b7728374356 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:22.301919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a6288d33-b0da-4232-85e5-1b7728374356 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:22.392260 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a6288d33-b0da-4232-85e5-1b7728374356 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:22.406543 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a6288d33-b0da-4232-85e5-1b7728374356 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1293 microversion: 2.1 time: 0.120794 Aug 22 17:34:22.410057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 346/691] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:22 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1293 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:23.438390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-236f4e5a-e487-4df3-9ef7-02b234e2b2da tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:23.439351 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-236f4e5a-e487-4df3-9ef7-02b234e2b2da tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:23.450996 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-236f4e5a-e487-4df3-9ef7-02b234e2b2da tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:23.450996 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-236f4e5a-e487-4df3-9ef7-02b234e2b2da tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:23.450996 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-236f4e5a-e487-4df3-9ef7-02b234e2b2da tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:23.451625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-236f4e5a-e487-4df3-9ef7-02b234e2b2da tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:23.451870 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-236f4e5a-e487-4df3-9ef7-02b234e2b2da tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:23.452307 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-236f4e5a-e487-4df3-9ef7-02b234e2b2da tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:23.682641 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-236f4e5a-e487-4df3-9ef7-02b234e2b2da tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:23.692293 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-236f4e5a-e487-4df3-9ef7-02b234e2b2da tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1299 microversion: 2.1 time: 0.264107 Aug 22 17:34:23.694106 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 346/692] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:23 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1299 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:34:24.722022 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-508f7466-2b2e-43af-9932-f9e41f27dd34 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:24.723459 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-508f7466-2b2e-43af-9932-f9e41f27dd34 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:24.733415 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-508f7466-2b2e-43af-9932-f9e41f27dd34 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:24.734291 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-508f7466-2b2e-43af-9932-f9e41f27dd34 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:24.735284 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-508f7466-2b2e-43af-9932-f9e41f27dd34 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:24.736320 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-508f7466-2b2e-43af-9932-f9e41f27dd34 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:24.737127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-508f7466-2b2e-43af-9932-f9e41f27dd34 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:24.737774 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-508f7466-2b2e-43af-9932-f9e41f27dd34 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:24.837841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-508f7466-2b2e-43af-9932-f9e41f27dd34 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:24.852071 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-508f7466-2b2e-43af-9932-f9e41f27dd34 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1299 microversion: 2.1 time: 0.133682 Aug 22 17:34:24.853658 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 347/693] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:24 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1299 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:25.876184 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e754a681-5be9-4689-a6b3-49bf18b2a9a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:25.877506 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e754a681-5be9-4689-a6b3-49bf18b2a9a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:25.885412 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e754a681-5be9-4689-a6b3-49bf18b2a9a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:25.886507 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e754a681-5be9-4689-a6b3-49bf18b2a9a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:25.887202 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e754a681-5be9-4689-a6b3-49bf18b2a9a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:25.888224 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e754a681-5be9-4689-a6b3-49bf18b2a9a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:25.888915 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e754a681-5be9-4689-a6b3-49bf18b2a9a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:25.889532 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e754a681-5be9-4689-a6b3-49bf18b2a9a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:26.097293 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e754a681-5be9-4689-a6b3-49bf18b2a9a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:26.114210 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e754a681-5be9-4689-a6b3-49bf18b2a9a2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1367 microversion: 2.1 time: 0.242132 Aug 22 17:34:26.115300 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 347/694] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:25 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:26.591816 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-f680d3ce-8018-4042-9b0d-c46508def960 req-35ebc58f-f074-4547-b3a4-76970cb9cecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da06f40f-ae38-492b-8867-2ffe54655d17", "tag": "074dcdd1-c55a-4f30-b411-c39e5026a6c5"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:26.618969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-f680d3ce-8018-4042-9b0d-c46508def960 req-35ebc58f-f074-4547-b3a4-76970cb9cecc service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:26.622685 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-f680d3ce-8018-4042-9b0d-c46508def960 req-35ebc58f-f074-4547-b3a4-76970cb9cecc service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:26.622685 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-f680d3ce-8018-4042-9b0d-c46508def960 req-35ebc58f-f074-4547-b3a4-76970cb9cecc service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:26.654511 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-f680d3ce-8018-4042-9b0d-c46508def960 req-35ebc58f-f074-4547-b3a4-76970cb9cecc service nova] Creating event network-changed:074dcdd1-c55a-4f30-b411-c39e5026a6c5 for instance da06f40f-ae38-492b-8867-2ffe54655d17 on hv-cinder-85394 Aug 22 17:34:26.665369 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-f680d3ce-8018-4042-9b0d-c46508def960 req-35ebc58f-f074-4547-b3a4-76970cb9cecc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084164 Aug 22 17:34:26.666861 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 348/695] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:34:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:34:27.137633 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-abe2d2b6-06eb-413a-82c8-78e966f19895 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:27.139086 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-abe2d2b6-06eb-413a-82c8-78e966f19895 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:27.146442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-abe2d2b6-06eb-413a-82c8-78e966f19895 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:27.147280 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-abe2d2b6-06eb-413a-82c8-78e966f19895 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:27.147923 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-abe2d2b6-06eb-413a-82c8-78e966f19895 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:27.148654 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-abe2d2b6-06eb-413a-82c8-78e966f19895 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:27.149717 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-abe2d2b6-06eb-413a-82c8-78e966f19895 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:27.150565 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-abe2d2b6-06eb-413a-82c8-78e966f19895 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:27.476798 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-abe2d2b6-06eb-413a-82c8-78e966f19895 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:27.490099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-abe2d2b6-06eb-413a-82c8-78e966f19895 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1367 microversion: 2.1 time: 0.357473 Aug 22 17:34:27.498730 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 348/696] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:27 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1367 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:28.527978 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e80c6570-76d3-4892-876f-2869ae817060 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:28.527978 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e80c6570-76d3-4892-876f-2869ae817060 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:28.534875 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e80c6570-76d3-4892-876f-2869ae817060 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:28.535369 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e80c6570-76d3-4892-876f-2869ae817060 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:28.535798 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e80c6570-76d3-4892-876f-2869ae817060 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:28.536718 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e80c6570-76d3-4892-876f-2869ae817060 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:28.537359 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e80c6570-76d3-4892-876f-2869ae817060 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:28.537816 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e80c6570-76d3-4892-876f-2869ae817060 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:28.729710 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e80c6570-76d3-4892-876f-2869ae817060 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:28.739286 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e80c6570-76d3-4892-876f-2869ae817060 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1367 microversion: 2.1 time: 0.227973 Aug 22 17:34:28.739911 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 349/697] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:28 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:29.770761 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-7821709d-1265-4548-a1e6-7d961b0be168 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:29.771489 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-7821709d-1265-4548-a1e6-7d961b0be168 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:29.780264 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7821709d-1265-4548-a1e6-7d961b0be168 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:29.780920 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7821709d-1265-4548-a1e6-7d961b0be168 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:29.781598 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7821709d-1265-4548-a1e6-7d961b0be168 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:29.782464 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7821709d-1265-4548-a1e6-7d961b0be168 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:29.783168 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7821709d-1265-4548-a1e6-7d961b0be168 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:29.783819 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7821709d-1265-4548-a1e6-7d961b0be168 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:29.843742 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:30.022194 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-7821709d-1265-4548-a1e6-7d961b0be168 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:30.037048 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-7821709d-1265-4548-a1e6-7d961b0be168 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1367 microversion: 2.1 time: 0.271038 Aug 22 17:34:30.043390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 349/698] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:29 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1367 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:31.081623 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a3358b19-b008-48c9-bced-73136e164c45 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:31.083764 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a3358b19-b008-48c9-bced-73136e164c45 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:31.088844 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=6 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:31.098241 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a3358b19-b008-48c9-bced-73136e164c45 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:31.099622 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a3358b19-b008-48c9-bced-73136e164c45 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:31.100573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a3358b19-b008-48c9-bced-73136e164c45 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:31.102341 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a3358b19-b008-48c9-bced-73136e164c45 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:31.103321 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a3358b19-b008-48c9-bced-73136e164c45 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:31.104189 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a3358b19-b008-48c9-bced-73136e164c45 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:31.513101 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a3358b19-b008-48c9-bced-73136e164c45 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:31.531668 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a3358b19-b008-48c9-bced-73136e164c45 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1367 microversion: 2.1 time: 0.448519 Aug 22 17:34:31.531668 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 350/699] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:31 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1367 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:32.559577 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-23fe0b0b-a66a-4d2e-8c7c-4b5da2e3c787 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:32.560303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-23fe0b0b-a66a-4d2e-8c7c-4b5da2e3c787 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:32.567437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=8 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:32.570127 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-23fe0b0b-a66a-4d2e-8c7c-4b5da2e3c787 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:32.571277 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-23fe0b0b-a66a-4d2e-8c7c-4b5da2e3c787 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:32.572282 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-23fe0b0b-a66a-4d2e-8c7c-4b5da2e3c787 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:32.573102 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-23fe0b0b-a66a-4d2e-8c7c-4b5da2e3c787 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:32.573597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-23fe0b0b-a66a-4d2e-8c7c-4b5da2e3c787 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:32.574089 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-23fe0b0b-a66a-4d2e-8c7c-4b5da2e3c787 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:32.603403 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-66d5f453-8482-483b-829c-411d41d794a5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:32.604251 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-66d5f453-8482-483b-829c-411d41d794a5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:32.626110 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-66d5f453-8482-483b-829c-411d41d794a5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:32.627726 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-66d5f453-8482-483b-829c-411d41d794a5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:32.628350 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-66d5f453-8482-483b-829c-411d41d794a5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:32.629617 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-66d5f453-8482-483b-829c-411d41d794a5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:32.630270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-66d5f453-8482-483b-829c-411d41d794a5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:32.631841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-66d5f453-8482-483b-829c-411d41d794a5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:32.683804 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-66d5f453-8482-483b-829c-411d41d794a5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/os-volume_attachments/bdcd836d-948b-4eb4-8fe0-1454794a33ed" status: 200 len: 194 microversion: 2.20 time: 0.086708 Aug 22 17:34:32.686691 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 351/700] 10.222.0.20 () {60 vars in 1454 bytes} [Mon Aug 22 17:34:32 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/os-volume_attachments/bdcd836d-948b-4eb4-8fe0-1454794a33ed => generated 194 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:34:32.818903 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c61ff10b-37c3-4e8b-80da-557dc1edc722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:32.820290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c61ff10b-37c3-4e8b-80da-557dc1edc722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:32.834765 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c61ff10b-37c3-4e8b-80da-557dc1edc722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:32.834765 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c61ff10b-37c3-4e8b-80da-557dc1edc722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:32.835036 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c61ff10b-37c3-4e8b-80da-557dc1edc722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:32.836250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c61ff10b-37c3-4e8b-80da-557dc1edc722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:32.838936 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c61ff10b-37c3-4e8b-80da-557dc1edc722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:32.839708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c61ff10b-37c3-4e8b-80da-557dc1edc722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:32.882674 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-23fe0b0b-a66a-4d2e-8c7c-4b5da2e3c787 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:32.898380 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-23fe0b0b-a66a-4d2e-8c7c-4b5da2e3c787 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1367 microversion: 2.1 time: 0.343384 Aug 22 17:34:32.900857 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 350/701] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:32 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1367 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:33.092991 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-c61ff10b-37c3-4e8b-80da-557dc1edc722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lazy-loading 'services' on Instance uuid fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:34:33.521997 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c61ff10b-37c3-4e8b-80da-557dc1edc722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/os-volume_attachments/bdcd836d-948b-4eb4-8fe0-1454794a33ed" status: 202 len: 0 microversion: 2.20 time: 0.709143 Aug 22 17:34:33.523077 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 352/702] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Aug 22 17:34:32 2022] DELETE /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/os-volume_attachments/bdcd836d-948b-4eb4-8fe0-1454794a33ed => generated 0 bytes in 711 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 22 17:34:33.534702 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-534fb2c4-212d-45e7-8376-61fd96d5bec6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:33.538619 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-534fb2c4-212d-45e7-8376-61fd96d5bec6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:33.549384 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-534fb2c4-212d-45e7-8376-61fd96d5bec6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:33.550617 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-534fb2c4-212d-45e7-8376-61fd96d5bec6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:33.551658 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-534fb2c4-212d-45e7-8376-61fd96d5bec6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:33.553313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-534fb2c4-212d-45e7-8376-61fd96d5bec6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:33.554554 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-534fb2c4-212d-45e7-8376-61fd96d5bec6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:33.555891 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-534fb2c4-212d-45e7-8376-61fd96d5bec6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:33.596459 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-534fb2c4-212d-45e7-8376-61fd96d5bec6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066460 Aug 22 17:34:33.598761 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 351/703] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 22 17:34:33 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:34:33.931002 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-7bc0f29e-922a-4598-b206-c836faab6b14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:33.931900 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-7bc0f29e-922a-4598-b206-c836faab6b14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:33.943583 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7bc0f29e-922a-4598-b206-c836faab6b14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:33.943583 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7bc0f29e-922a-4598-b206-c836faab6b14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:33.943583 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7bc0f29e-922a-4598-b206-c836faab6b14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:33.943583 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7bc0f29e-922a-4598-b206-c836faab6b14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:33.944333 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7bc0f29e-922a-4598-b206-c836faab6b14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:33.944333 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7bc0f29e-922a-4598-b206-c836faab6b14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:34.616158 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-99bc0804-e57f-48e6-9512-914f1d6288c0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:34.622022 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-99bc0804-e57f-48e6-9512-914f1d6288c0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:34.647749 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-99bc0804-e57f-48e6-9512-914f1d6288c0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:34.651437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-99bc0804-e57f-48e6-9512-914f1d6288c0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:34.652507 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-99bc0804-e57f-48e6-9512-914f1d6288c0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:34.655336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-99bc0804-e57f-48e6-9512-914f1d6288c0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:34.656447 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-99bc0804-e57f-48e6-9512-914f1d6288c0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:34.657401 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-99bc0804-e57f-48e6-9512-914f1d6288c0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:34.721065 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7bc0f29e-922a-4598-b206-c836faab6b14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:34.756400 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-7bc0f29e-922a-4598-b206-c836faab6b14 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1367 microversion: 2.1 time: 0.830321 Aug 22 17:34:34.757592 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-99bc0804-e57f-48e6-9512-914f1d6288c0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.147753 Aug 22 17:34:34.759803 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 353/704] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:33 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1367 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:34:34.760739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 352/705] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 22 17:34:34 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:34:35.801438 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-1d8605bd-aee4-41b6-8770-f8ae59549402 req-864164aa-90db-4906-9687-33a3c67c62b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da06f40f-ae38-492b-8867-2ffe54655d17", "name": "network-vif-plugged", "status": "completed", "tag": "074dcdd1-c55a-4f30-b411-c39e5026a6c5"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:35.803660 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-840539b8-10f9-4826-bf64-63daca23fdb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:35.814158 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-840539b8-10f9-4826-bf64-63daca23fdb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:35.844144 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-840539b8-10f9-4826-bf64-63daca23fdb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:35.846294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-840539b8-10f9-4826-bf64-63daca23fdb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:35.847129 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-840539b8-10f9-4826-bf64-63daca23fdb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:35.848693 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-1d8605bd-aee4-41b6-8770-f8ae59549402 req-864164aa-90db-4906-9687-33a3c67c62b2 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:35.850338 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-1d8605bd-aee4-41b6-8770-f8ae59549402 req-864164aa-90db-4906-9687-33a3c67c62b2 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:35.857322 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-1d8605bd-aee4-41b6-8770-f8ae59549402 req-864164aa-90db-4906-9687-33a3c67c62b2 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:35.857561 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-840539b8-10f9-4826-bf64-63daca23fdb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:35.857561 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-840539b8-10f9-4826-bf64-63daca23fdb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:35.857561 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-840539b8-10f9-4826-bf64-63daca23fdb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:35.879961 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:35.921125 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-1d8605bd-aee4-41b6-8770-f8ae59549402 req-864164aa-90db-4906-9687-33a3c67c62b2 service nova] Creating event network-vif-plugged:074dcdd1-c55a-4f30-b411-c39e5026a6c5 for instance da06f40f-ae38-492b-8867-2ffe54655d17 on hv-cinder-85394 Aug 22 17:34:35.947649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-1d8605bd-aee4-41b6-8770-f8ae59549402 req-864164aa-90db-4906-9687-33a3c67c62b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.153822 Aug 22 17:34:35.953476 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 353/706] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:34:35.980082 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-61725633-33d7-4816-95c9-721f8d143592 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:35.981674 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-61725633-33d7-4816-95c9-721f8d143592 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:35.994264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-840539b8-10f9-4826-bf64-63daca23fdb3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.207746 Aug 22 17:34:36.003110 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 354/707] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 22 17:34:35 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32/os-volume_attachments => generated 25 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:36.011581 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-61725633-33d7-4816-95c9-721f8d143592 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:36.013417 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-61725633-33d7-4816-95c9-721f8d143592 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:36.015090 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-61725633-33d7-4816-95c9-721f8d143592 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:36.016812 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-61725633-33d7-4816-95c9-721f8d143592 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:36.018546 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-61725633-33d7-4816-95c9-721f8d143592 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:36.019674 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-61725633-33d7-4816-95c9-721f8d143592 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:36.215272 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-9aac0cbd-4d6a-4ab4-af9d-a732de6e50c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:36.215928 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9aac0cbd-4d6a-4ab4-af9d-a732de6e50c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:36.235564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9aac0cbd-4d6a-4ab4-af9d-a732de6e50c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:36.235991 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9aac0cbd-4d6a-4ab4-af9d-a732de6e50c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:36.236580 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9aac0cbd-4d6a-4ab4-af9d-a732de6e50c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:36.237546 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9aac0cbd-4d6a-4ab4-af9d-a732de6e50c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:36.238121 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9aac0cbd-4d6a-4ab4-af9d-a732de6e50c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:36.238903 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9aac0cbd-4d6a-4ab4-af9d-a732de6e50c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:36.283299 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9aac0cbd-4d6a-4ab4-af9d-a732de6e50c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Going to try to terminate instance {{(pid=121853) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:34:36.367411 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-61725633-33d7-4816-95c9-721f8d143592 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:36.386076 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-61725633-33d7-4816-95c9-721f8d143592 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1367 microversion: 2.1 time: 0.428359 Aug 22 17:34:36.387346 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 354/708] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:35 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1367 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:36.702008 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-9aac0cbd-4d6a-4ab4-af9d-a732de6e50c6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 204 len: 0 microversion: 2.20 time: 0.493656 Aug 22 17:34:36.708005 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 355/709] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 22 17:34:36 2022] DELETE /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 22 17:34:36.718816 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-1ee45eb6-3a17-40d7-b04f-e8f219d1c2b9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:36.720965 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-1ee45eb6-3a17-40d7-b04f-e8f219d1c2b9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:36.734034 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1ee45eb6-3a17-40d7-b04f-e8f219d1c2b9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:36.735611 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1ee45eb6-3a17-40d7-b04f-e8f219d1c2b9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:36.736700 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1ee45eb6-3a17-40d7-b04f-e8f219d1c2b9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:36.744216 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1ee45eb6-3a17-40d7-b04f-e8f219d1c2b9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:36.747106 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1ee45eb6-3a17-40d7-b04f-e8f219d1c2b9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:36.748322 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1ee45eb6-3a17-40d7-b04f-e8f219d1c2b9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:36.954822 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-1ee45eb6-3a17-40d7-b04f-e8f219d1c2b9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:36.959805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:36.969166 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-1ee45eb6-3a17-40d7-b04f-e8f219d1c2b9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:36.971507 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-1ee45eb6-3a17-40d7-b04f-e8f219d1c2b9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:36.973210 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-1ee45eb6-3a17-40d7-b04f-e8f219d1c2b9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.262419 Aug 22 17:34:36.991062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 355/710] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:36 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:34:37.429604 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0e1545cb-3412-4521-8e3b-40a780652f6a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:37.435650 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0e1545cb-3412-4521-8e3b-40a780652f6a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:37.446437 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0e1545cb-3412-4521-8e3b-40a780652f6a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:37.447441 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0e1545cb-3412-4521-8e3b-40a780652f6a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:37.448685 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0e1545cb-3412-4521-8e3b-40a780652f6a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:37.449455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0e1545cb-3412-4521-8e3b-40a780652f6a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:37.449958 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0e1545cb-3412-4521-8e3b-40a780652f6a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:37.450444 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0e1545cb-3412-4521-8e3b-40a780652f6a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:37.767456 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0e1545cb-3412-4521-8e3b-40a780652f6a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:37.784251 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0e1545cb-3412-4521-8e3b-40a780652f6a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1367 microversion: 2.1 time: 0.361524 Aug 22 17:34:37.785525 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 356/711] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:37 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:38.003621 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e28080ed-ae1b-4ce1-a25a-8d9f37d3562d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:38.006221 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e28080ed-ae1b-4ce1-a25a-8d9f37d3562d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:38.025844 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e28080ed-ae1b-4ce1-a25a-8d9f37d3562d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:38.025844 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e28080ed-ae1b-4ce1-a25a-8d9f37d3562d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:38.025844 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e28080ed-ae1b-4ce1-a25a-8d9f37d3562d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:38.026679 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e28080ed-ae1b-4ce1-a25a-8d9f37d3562d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:38.027861 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e28080ed-ae1b-4ce1-a25a-8d9f37d3562d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:38.028879 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e28080ed-ae1b-4ce1-a25a-8d9f37d3562d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:38.342170 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e28080ed-ae1b-4ce1-a25a-8d9f37d3562d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:38.358270 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e28080ed-ae1b-4ce1-a25a-8d9f37d3562d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:38.363190 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e28080ed-ae1b-4ce1-a25a-8d9f37d3562d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:38.365246 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e28080ed-ae1b-4ce1-a25a-8d9f37d3562d tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.367864 Aug 22 17:34:38.366566 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 356/712] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:37 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:34:38.824046 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-28f06e0d-9b20-4220-a80c-eb997f076f59 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:38.826598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-28f06e0d-9b20-4220-a80c-eb997f076f59 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:38.841137 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28f06e0d-9b20-4220-a80c-eb997f076f59 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:38.842011 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28f06e0d-9b20-4220-a80c-eb997f076f59 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:38.842834 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28f06e0d-9b20-4220-a80c-eb997f076f59 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:38.845048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28f06e0d-9b20-4220-a80c-eb997f076f59 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:38.845892 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28f06e0d-9b20-4220-a80c-eb997f076f59 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:38.846687 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28f06e0d-9b20-4220-a80c-eb997f076f59 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:39.235139 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-28f06e0d-9b20-4220-a80c-eb997f076f59 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:39.257027 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-28f06e0d-9b20-4220-a80c-eb997f076f59 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1367 microversion: 2.1 time: 0.442274 Aug 22 17:34:39.259437 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 357/713] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:38 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1367 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:39.409608 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-430a4ac6-6a55-4f41-9069-a6ff58e0b690 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:39.412001 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-430a4ac6-6a55-4f41-9069-a6ff58e0b690 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:39.426442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-430a4ac6-6a55-4f41-9069-a6ff58e0b690 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:39.433331 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-430a4ac6-6a55-4f41-9069-a6ff58e0b690 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:39.433331 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-430a4ac6-6a55-4f41-9069-a6ff58e0b690 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:39.433331 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-430a4ac6-6a55-4f41-9069-a6ff58e0b690 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:39.433331 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-430a4ac6-6a55-4f41-9069-a6ff58e0b690 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:39.433805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-430a4ac6-6a55-4f41-9069-a6ff58e0b690 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:39.650344 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-430a4ac6-6a55-4f41-9069-a6ff58e0b690 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:39.668180 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-430a4ac6-6a55-4f41-9069-a6ff58e0b690 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:39.671701 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-430a4ac6-6a55-4f41-9069-a6ff58e0b690 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:39.674503 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-430a4ac6-6a55-4f41-9069-a6ff58e0b690 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.271800 Aug 22 17:34:39.678546 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 357/714] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:39 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:34:40.296059 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a011c09c-c976-4d38-84d8-c22c14d51037 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:40.296059 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a011c09c-c976-4d38-84d8-c22c14d51037 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:40.300358 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a011c09c-c976-4d38-84d8-c22c14d51037 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:40.300855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a011c09c-c976-4d38-84d8-c22c14d51037 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:40.301297 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a011c09c-c976-4d38-84d8-c22c14d51037 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:40.302048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a011c09c-c976-4d38-84d8-c22c14d51037 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:40.302516 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a011c09c-c976-4d38-84d8-c22c14d51037 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:40.303135 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a011c09c-c976-4d38-84d8-c22c14d51037 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:40.705903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-da77c073-7e02-4dfb-9b5b-96bf861e090f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:40.707496 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-da77c073-7e02-4dfb-9b5b-96bf861e090f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:40.716488 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da77c073-7e02-4dfb-9b5b-96bf861e090f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:40.717464 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da77c073-7e02-4dfb-9b5b-96bf861e090f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:40.718073 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da77c073-7e02-4dfb-9b5b-96bf861e090f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:40.719062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da77c073-7e02-4dfb-9b5b-96bf861e090f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:40.719772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da77c073-7e02-4dfb-9b5b-96bf861e090f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:40.720612 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-da77c073-7e02-4dfb-9b5b-96bf861e090f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:40.759924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a011c09c-c976-4d38-84d8-c22c14d51037 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:40.769089 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a011c09c-c976-4d38-84d8-c22c14d51037 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1556 microversion: 2.1 time: 0.481624 Aug 22 17:34:40.782515 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 358/715] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:40 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1556 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:40.802619 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-acc2a4c6-a23b-465c-82a1-792b07624062 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:40.803029 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-acc2a4c6-a23b-465c-82a1-792b07624062 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:40.810853 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-acc2a4c6-a23b-465c-82a1-792b07624062 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:40.812420 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-acc2a4c6-a23b-465c-82a1-792b07624062 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:40.812420 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-acc2a4c6-a23b-465c-82a1-792b07624062 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:40.813290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-acc2a4c6-a23b-465c-82a1-792b07624062 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:40.813853 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-acc2a4c6-a23b-465c-82a1-792b07624062 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:40.814384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-acc2a4c6-a23b-465c-82a1-792b07624062 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:40.942967 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-da77c073-7e02-4dfb-9b5b-96bf861e090f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:40.952672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-da77c073-7e02-4dfb-9b5b-96bf861e090f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:40.954298 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-da77c073-7e02-4dfb-9b5b-96bf861e090f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:40.955654 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-da77c073-7e02-4dfb-9b5b-96bf861e090f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1722 microversion: 2.20 time: 0.258046 Aug 22 17:34:40.956527 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 358/716] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:40 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1722 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:34:40.991364 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-acc2a4c6-a23b-465c-82a1-792b07624062 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.192573 Aug 22 17:34:40.992136 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 359/717] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 22 17:34:40 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-interface => generated 284 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:34:41.722957 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-b34f484f-630e-48b4-b39a-21a42ec6e37f req-5a95423a-61b8-478a-9c9a-ab8407c1ff7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcb3959b-fd48-4a97-81d0-5b74ec4cfd32", "name": "network-vif-deleted", "tag": "703038a4-7ff6-4222-b6d6-2865ce69bda5"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:41.749628 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-b34f484f-630e-48b4-b39a-21a42ec6e37f req-5a95423a-61b8-478a-9c9a-ab8407c1ff7a service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:41.750120 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-b34f484f-630e-48b4-b39a-21a42ec6e37f req-5a95423a-61b8-478a-9c9a-ab8407c1ff7a service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:41.750578 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-b34f484f-630e-48b4-b39a-21a42ec6e37f req-5a95423a-61b8-478a-9c9a-ab8407c1ff7a service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:41.791020 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d4b156d1-08f8-4d55-bb85-688565ce4e83 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Action: 'create', calling method: .version_select at 0x7f0e60ee9a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-567724700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgF8n/MCY05aSklgR0+od079GeK+N8+7GaNCCf/9Pe1VLuvQtyiStShavQ8BHO1xfir/dqNltQiTu1tSco4IzGpTO5dbmMz9tGZkmbdhlabVnrnvWPaYr1LPhnin8zNRg=="}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:41.792928 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-b34f484f-630e-48b4-b39a-21a42ec6e37f req-5a95423a-61b8-478a-9c9a-ab8407c1ff7a service nova] Creating event network-vif-deleted:703038a4-7ff6-4222-b6d6-2865ce69bda5 for instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 on hv-cinder-85394 Aug 22 17:34:41.802466 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-b34f484f-630e-48b4-b39a-21a42ec6e37f req-5a95423a-61b8-478a-9c9a-ab8407c1ff7a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082958 Aug 22 17:34:41.809739 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 360/718] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:34:41.816815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-d4b156d1-08f8-4d55-bb85-688565ce4e83 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Getting quotas for project 43d4499a9d9f4c00a09c867bb403dd30. Resources: {'key_pairs'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:34:41.823420 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-d4b156d1-08f8-4d55-bb85-688565ce4e83 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Getting quotas for user aa55b9fade0047c68c2f3f6bf4dfe44e and project 43d4499a9d9f4c00a09c867bb403dd30. Resources: {'key_pairs'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:34:41.984530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8de1f743-7522-4878-81db-966158512935 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:41.985599 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8de1f743-7522-4878-81db-966158512935 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:41.996229 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d4b156d1-08f8-4d55-bb85-688565ce4e83 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.765286 Aug 22 17:34:42.005649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 359/719] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 22 17:34:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:34:42.020038 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8de1f743-7522-4878-81db-966158512935 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:42.020038 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8de1f743-7522-4878-81db-966158512935 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:42.020561 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8de1f743-7522-4878-81db-966158512935 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:42.022454 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8de1f743-7522-4878-81db-966158512935 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:42.024271 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8de1f743-7522-4878-81db-966158512935 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:42.025430 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8de1f743-7522-4878-81db-966158512935 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:42.204781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8de1f743-7522-4878-81db-966158512935 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:42.231533 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8de1f743-7522-4878-81db-966158512935 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:42.236511 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8de1f743-7522-4878-81db-966158512935 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:42.244151 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8de1f743-7522-4878-81db-966158512935 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 200 len: 1365 microversion: 2.20 time: 0.261925 Aug 22 17:34:42.246304 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 361/720] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:41 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:34:43.286351 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-11e05c02-7575-4a0d-9de0-f7c610d062c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:43.287006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-11e05c02-7575-4a0d-9de0-f7c610d062c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:43.307719 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11e05c02-7575-4a0d-9de0-f7c610d062c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:43.310675 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11e05c02-7575-4a0d-9de0-f7c610d062c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:43.312770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11e05c02-7575-4a0d-9de0-f7c610d062c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:43.313671 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11e05c02-7575-4a0d-9de0-f7c610d062c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:43.315328 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11e05c02-7575-4a0d-9de0-f7c610d062c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:43.316415 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-11e05c02-7575-4a0d-9de0-f7c610d062c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:43.348584 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-11e05c02-7575-4a0d-9de0-f7c610d062c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] HTTP exception thrown: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-11e05c02-7575-4a0d-9de0-f7c610d062c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Request method failure captured: Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 HTTP/1.1 Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xUtP-ikb0eO8-L8wa1U9tVnibx7-nGJqwmYbXf2MT1WxarA_36bruP5z3HPY_iasZlQTJej7wleO02jFCwb31Ht2XNYuRcgJ5iVmm2myKTiDU_0uj66-YheAnyu-sa6ej5AyWkMhn9WxiOxjxiMxJuc-CjWVB0slYCz2QJM91qf98 Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: c20e7f3aca4c49ae84390a3f1a8ce410 Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:34:43.350437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:34:43.353111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c20e7f3aca4c49ae84390a3f1a8ce410", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:34:43.353111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:34:43.353111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: c20e7f3aca4c49ae84390a3f1a8ce410 Aug 22 17:34:43.353111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:34:43.353111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeShelveTestJSON-830857878-project Aug 22 17:34:43.353111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:34:43.353111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:34:43.353111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 864d7f47381e4e4498ad110dbfcfc154 Aug 22 17:34:43.353111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeShelveTestJSON-830857878-project Aug 22 17:34:43.353111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:34:43.353111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:34:43.353111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': 'fcb3959b-fd48-4a97-81d0-5b74ec4cfd32'} Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:34:43.354128 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:34:43.356013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:34:43.357539 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-11e05c02-7575-4a0d-9de0-f7c610d062c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Returning 404 to user: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:34:43.357539 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-11e05c02-7575-4a0d-9de0-f7c610d062c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 404 len: 111 microversion: 2.20 time: 0.073372 Aug 22 17:34:43.357539 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 360/721] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:43 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:34:43.368910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ff7bf517-b114-44d3-b8c4-5e4085893d13 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '.version_select at 0x7f0e5c5c7670>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:43.452471 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-15a181a4-0f4a-48d7-a04c-b2d06e1db836 req-f2870181-d204-4d9d-893d-380d2202f65e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da06f40f-ae38-492b-8867-2ffe54655d17", "tag": "074dcdd1-c55a-4f30-b411-c39e5026a6c5"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:43.464766 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ff7bf517-b114-44d3-b8c4-5e4085893d13 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-962715784" status: 204 len: 0 microversion: 2.20 time: 0.102342 Aug 22 17:34:43.466915 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-15a181a4-0f4a-48d7-a04c-b2d06e1db836 req-f2870181-d204-4d9d-893d-380d2202f65e service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:43.467614 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-15a181a4-0f4a-48d7-a04c-b2d06e1db836 req-f2870181-d204-4d9d-893d-380d2202f65e service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:43.468203 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-15a181a4-0f4a-48d7-a04c-b2d06e1db836 req-f2870181-d204-4d9d-893d-380d2202f65e service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:43.468978 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 362/722] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Aug 22 17:34:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-962715784 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 22 17:34:43.510817 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-15a181a4-0f4a-48d7-a04c-b2d06e1db836 req-f2870181-d204-4d9d-893d-380d2202f65e service nova] Creating event network-changed:074dcdd1-c55a-4f30-b411-c39e5026a6c5 for instance da06f40f-ae38-492b-8867-2ffe54655d17 on hv-cinder-85394 Aug 22 17:34:43.526780 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-15a181a4-0f4a-48d7-a04c-b2d06e1db836 req-f2870181-d204-4d9d-893d-380d2202f65e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078163 Aug 22 17:34:43.530591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 361/723] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:34:43.754113 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-023c4038-1505-4c32-af97-5ad08b2d5308 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:43.762215 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-023c4038-1505-4c32-af97-5ad08b2d5308 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:43.764383 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-023c4038-1505-4c32-af97-5ad08b2d5308 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:43.766662 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-023c4038-1505-4c32-af97-5ad08b2d5308 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:43.768362 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-023c4038-1505-4c32-af97-5ad08b2d5308 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:43.769353 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-023c4038-1505-4c32-af97-5ad08b2d5308 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:43.770003 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-023c4038-1505-4c32-af97-5ad08b2d5308 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:43.770629 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-023c4038-1505-4c32-af97-5ad08b2d5308 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:44.020990 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-023c4038-1505-4c32-af97-5ad08b2d5308 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lazy-loading 'services' on Instance uuid 66347883-f0bf-4bbb-ba12-db82ee8d89c3 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:34:44.299638 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-023c4038-1505-4c32-af97-5ad08b2d5308 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "DELETE /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-volume_attachments/0fd9c053-bd29-4360-bdd3-dcecd7d4bed6" status: 202 len: 0 microversion: 2.1 time: 0.550638 Aug 22 17:34:44.311811 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 363/724] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 22 17:34:43 2022] DELETE /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-volume_attachments/0fd9c053-bd29-4360-bdd3-dcecd7d4bed6 => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:34:44.322714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-06dc1a09-864a-4b2d-bb12-87b089e7a144 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:44.325134 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-06dc1a09-864a-4b2d-bb12-87b089e7a144 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:44.333097 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-06dc1a09-864a-4b2d-bb12-87b089e7a144 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:44.333910 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-06dc1a09-864a-4b2d-bb12-87b089e7a144 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:44.334557 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-06dc1a09-864a-4b2d-bb12-87b089e7a144 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:44.335495 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-06dc1a09-864a-4b2d-bb12-87b089e7a144 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:44.336261 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-06dc1a09-864a-4b2d-bb12-87b089e7a144 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:44.336868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-06dc1a09-864a-4b2d-bb12-87b089e7a144 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:44.376914 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-06dc1a09-864a-4b2d-bb12-87b089e7a144 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059695 Aug 22 17:34:44.377777 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 362/725] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:34:44 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:34:45.310310 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-87db473f-01c5-4707-9c9e-cdc6eef2c551 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Action: 'create', calling method: .version_select at 0x7f0e5c466940>, body: {"keypair": {"name": "tempest-keypair-891569955", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHRw2+3/axtsQeXXLk8tUD+d+C8IjTZ9vkeE6u9IuEQpdd5JbBFHNAL1NF2o1xy6cMjzCUheRCkf9PgyrYNq8tB1/YQA+1L0+1RKKtI7rjBm+OyYM+Ni8JMxQHKXS5uiiQ=="}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:45.368347 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-87db473f-01c5-4707-9c9e-cdc6eef2c551 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Getting quotas for project c20e7f3aca4c49ae84390a3f1a8ce410. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:34:45.381721 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-87db473f-01c5-4707-9c9e-cdc6eef2c551 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Getting quotas for user 864d7f47381e4e4498ad110dbfcfc154 and project c20e7f3aca4c49ae84390a3f1a8ce410. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:34:45.401000 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a1f56d56-61aa-4627-8f17-c9f9c46a65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:45.404781 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a1f56d56-61aa-4627-8f17-c9f9c46a65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:45.417782 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1f56d56-61aa-4627-8f17-c9f9c46a65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:45.419010 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1f56d56-61aa-4627-8f17-c9f9c46a65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:45.419784 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1f56d56-61aa-4627-8f17-c9f9c46a65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:45.420960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1f56d56-61aa-4627-8f17-c9f9c46a65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:45.422069 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1f56d56-61aa-4627-8f17-c9f9c46a65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:45.423177 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1f56d56-61aa-4627-8f17-c9f9c46a65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:45.501514 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a1f56d56-61aa-4627-8f17-c9f9c46a65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106971 Aug 22 17:34:45.502709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 363/726] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:34:45 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:34:45.520512 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-87db473f-01c5-4707-9c9e-cdc6eef2c551 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.221339 Aug 22 17:34:45.522061 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 364/727] 10.222.0.20 () {62 vars in 1200 bytes} [Mon Aug 22 17:34:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 225 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 22 17:34:46.518036 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-335e3379-df1e-40c8-b4e5-47ffa3439c2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:46.521746 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-335e3379-df1e-40c8-b4e5-47ffa3439c2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:46.531103 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-335e3379-df1e-40c8-b4e5-47ffa3439c2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:46.533284 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-335e3379-df1e-40c8-b4e5-47ffa3439c2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:46.534059 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-335e3379-df1e-40c8-b4e5-47ffa3439c2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:46.535083 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-335e3379-df1e-40c8-b4e5-47ffa3439c2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:46.535759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-335e3379-df1e-40c8-b4e5-47ffa3439c2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:46.536400 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-335e3379-df1e-40c8-b4e5-47ffa3439c2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:46.583509 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-335e3379-df1e-40c8-b4e5-47ffa3439c2d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.071125 Aug 22 17:34:46.584520 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 364/728] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:34:46 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:34:46.741191 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c7d95f37-1a85-4d95-905d-7832c29be157 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:46.743124 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c7d95f37-1a85-4d95-905d-7832c29be157 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:46.749559 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:46.765081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7d95f37-1a85-4d95-905d-7832c29be157 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:46.766004 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7d95f37-1a85-4d95-905d-7832c29be157 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:46.767168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7d95f37-1a85-4d95-905d-7832c29be157 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:46.768564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7d95f37-1a85-4d95-905d-7832c29be157 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:46.769673 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7d95f37-1a85-4d95-905d-7832c29be157 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:46.772873 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c7d95f37-1a85-4d95-905d-7832c29be157 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:46.821446 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c7d95f37-1a85-4d95-905d-7832c29be157 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Going to try to terminate instance {{(pid=121853) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:34:47.218518 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c7d95f37-1a85-4d95-905d-7832c29be157 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "DELETE /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 204 len: 0 microversion: 2.1 time: 0.485435 Aug 22 17:34:47.223378 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 365/729] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:34:46 2022] DELETE /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:34:47.231957 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-409b141d-292d-4de3-9a81-69e29ef34f7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:47.232943 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-409b141d-292d-4de3-9a81-69e29ef34f7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:47.243429 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-409b141d-292d-4de3-9a81-69e29ef34f7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:47.244645 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-409b141d-292d-4de3-9a81-69e29ef34f7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:47.245315 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-409b141d-292d-4de3-9a81-69e29ef34f7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:47.246589 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-409b141d-292d-4de3-9a81-69e29ef34f7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:47.247051 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-409b141d-292d-4de3-9a81-69e29ef34f7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:47.247783 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-409b141d-292d-4de3-9a81-69e29ef34f7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:47.530913 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-409b141d-292d-4de3-9a81-69e29ef34f7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:47.553942 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-409b141d-292d-4de3-9a81-69e29ef34f7e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1691 microversion: 2.1 time: 0.328081 Aug 22 17:34:47.555249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 365/730] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:47 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1691 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:48.585207 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2bc5408e-b245-4592-a936-cefecd8e2c7a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:48.587565 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2bc5408e-b245-4592-a936-cefecd8e2c7a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:48.597604 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2bc5408e-b245-4592-a936-cefecd8e2c7a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:48.598094 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2bc5408e-b245-4592-a936-cefecd8e2c7a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:48.598560 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2bc5408e-b245-4592-a936-cefecd8e2c7a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:48.599523 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2bc5408e-b245-4592-a936-cefecd8e2c7a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:48.599979 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2bc5408e-b245-4592-a936-cefecd8e2c7a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:48.600405 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2bc5408e-b245-4592-a936-cefecd8e2c7a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:48.788996 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2bc5408e-b245-4592-a936-cefecd8e2c7a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:48.800622 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2bc5408e-b245-4592-a936-cefecd8e2c7a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1691 microversion: 2.1 time: 0.221908 Aug 22 17:34:48.801213 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 366/731] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:48 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1691 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:48.882412 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-604772754", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "537f731f-9768-4793-98dd-71bb11c56034"}], "security_groups": [{"name": "tempest-securitygroup--598015809"}], "key_name": "tempest-keypair-891569955", "user_data": "}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:49.022604 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.network.neutron [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] validate_networks() for [('537f731f-9768-4793-98dd-71bb11c56034', None, None, None, None, None)] {{(pid=121852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:34:49.564149 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Flavor limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:34:49.564897 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Image limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:34:49.565742 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Flavor pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:34:49.566562 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Image pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:34:49.567319 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:34:49.584169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:49.585018 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:49.586309 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:49.588006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:49.588649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:49.589268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:49.611530 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Getting quotas for project c20e7f3aca4c49ae84390a3f1a8ce410. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:34:49.613211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:49.617050 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Getting quotas for user 864d7f47381e4e4498ad110dbfcfc154 and project c20e7f3aca4c49ae84390a3f1a8ce410. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:34:49.639096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Going to run 1 instances... {{(pid=121852) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:34:49.641618 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:34:49.824326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ebcae698-dd8c-4c4a-8983-e787c5255464 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:49.824973 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9feffc35-ea48-435e-93ae-dc93a32ed8a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.946768 Aug 22 17:34:49.825754 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 366/732] 10.222.0.20 () {62 vars in 1188 bytes} [Mon Aug 22 17:34:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 22 17:34:49.826467 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ebcae698-dd8c-4c4a-8983-e787c5255464 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:49.837903 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ebcae698-dd8c-4c4a-8983-e787c5255464 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:49.838860 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ebcae698-dd8c-4c4a-8983-e787c5255464 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:49.839819 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ebcae698-dd8c-4c4a-8983-e787c5255464 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:49.841465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ebcae698-dd8c-4c4a-8983-e787c5255464 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:49.842089 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ebcae698-dd8c-4c4a-8983-e787c5255464 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:49.842797 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ebcae698-dd8c-4c4a-8983-e787c5255464 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:49.847964 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-74c6b260-b624-466e-9388-7c250eb4675e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:49.850397 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-74c6b260-b624-466e-9388-7c250eb4675e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:49.926012 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-74c6b260-b624-466e-9388-7c250eb4675e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:49.936227 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-74c6b260-b624-466e-9388-7c250eb4675e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:49.938167 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-74c6b260-b624-466e-9388-7c250eb4675e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:49.939486 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-74c6b260-b624-466e-9388-7c250eb4675e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1280 microversion: 2.20 time: 0.096445 Aug 22 17:34:49.940060 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 367/733] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:49 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1280 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:34:50.078213 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ebcae698-dd8c-4c4a-8983-e787c5255464 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:50.090113 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ebcae698-dd8c-4c4a-8983-e787c5255464 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1691 microversion: 2.1 time: 0.269777 Aug 22 17:34:50.090951 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 367/734] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:49 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1691 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:50.987570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-14c69b5c-a33d-4e23-be03-d41be7489baf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:50.989048 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-14c69b5c-a33d-4e23-be03-d41be7489baf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:51.068738 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-14c69b5c-a33d-4e23-be03-d41be7489baf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:51.080860 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-14c69b5c-a33d-4e23-be03-d41be7489baf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:51.082969 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-14c69b5c-a33d-4e23-be03-d41be7489baf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:51.083940 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-14c69b5c-a33d-4e23-be03-d41be7489baf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1280 microversion: 2.20 time: 0.102196 Aug 22 17:34:51.084505 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 368/735] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:50 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1280 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:34:51.127787 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-efcb730e-3bf0-41f6-a511-2871686432c7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:51.128635 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-efcb730e-3bf0-41f6-a511-2871686432c7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:51.140372 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efcb730e-3bf0-41f6-a511-2871686432c7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:51.141237 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efcb730e-3bf0-41f6-a511-2871686432c7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:51.141998 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efcb730e-3bf0-41f6-a511-2871686432c7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:51.143282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efcb730e-3bf0-41f6-a511-2871686432c7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:51.144109 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efcb730e-3bf0-41f6-a511-2871686432c7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:51.144890 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efcb730e-3bf0-41f6-a511-2871686432c7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:51.468960 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-efcb730e-3bf0-41f6-a511-2871686432c7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:51.481306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-efcb730e-3bf0-41f6-a511-2871686432c7 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1691 microversion: 2.1 time: 0.361448 Aug 22 17:34:51.483133 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 368/736] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:51 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1691 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:52.112205 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f6a4ef03-e86e-492d-a392-52da8795a171 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:52.114345 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f6a4ef03-e86e-492d-a392-52da8795a171 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:52.126704 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f6a4ef03-e86e-492d-a392-52da8795a171 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:52.130876 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f6a4ef03-e86e-492d-a392-52da8795a171 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:52.130876 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f6a4ef03-e86e-492d-a392-52da8795a171 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:52.130876 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f6a4ef03-e86e-492d-a392-52da8795a171 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:52.130876 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f6a4ef03-e86e-492d-a392-52da8795a171 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:52.131628 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f6a4ef03-e86e-492d-a392-52da8795a171 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:52.244396 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f6a4ef03-e86e-492d-a392-52da8795a171 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:52.254712 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f6a4ef03-e86e-492d-a392-52da8795a171 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:52.256293 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f6a4ef03-e86e-492d-a392-52da8795a171 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:52.257502 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f6a4ef03-e86e-492d-a392-52da8795a171 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1332 microversion: 2.20 time: 0.152037 Aug 22 17:34:52.258306 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 369/737] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:52 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1332 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:34:52.526173 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6d642588-a823-4f3c-b6fb-ac37e7bdd752 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:52.527618 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6d642588-a823-4f3c-b6fb-ac37e7bdd752 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:52.538905 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6d642588-a823-4f3c-b6fb-ac37e7bdd752 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:52.540001 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6d642588-a823-4f3c-b6fb-ac37e7bdd752 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:52.540658 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6d642588-a823-4f3c-b6fb-ac37e7bdd752 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:52.541769 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6d642588-a823-4f3c-b6fb-ac37e7bdd752 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:52.542436 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6d642588-a823-4f3c-b6fb-ac37e7bdd752 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:52.543012 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6d642588-a823-4f3c-b6fb-ac37e7bdd752 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:52.685119 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6d642588-a823-4f3c-b6fb-ac37e7bdd752 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:52.703264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:52.712633 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6d642588-a823-4f3c-b6fb-ac37e7bdd752 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1623 microversion: 2.1 time: 0.204190 Aug 22 17:34:52.714391 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 369/738] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:52 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1623 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:52.717043 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-577dd8e4-8e57-46af-98a3-d7ec205bab57 req-abc44e4c-c283-4032-9c1e-f1a331fbd3ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66347883-f0bf-4bbb-ba12-db82ee8d89c3", "name": "network-vif-deleted", "tag": "c920306a-84f5-4723-a57f-bb8dc17b0207"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:52.748912 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-577dd8e4-8e57-46af-98a3-d7ec205bab57 req-abc44e4c-c283-4032-9c1e-f1a331fbd3ba service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:52.749711 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-577dd8e4-8e57-46af-98a3-d7ec205bab57 req-abc44e4c-c283-4032-9c1e-f1a331fbd3ba service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:52.750304 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-577dd8e4-8e57-46af-98a3-d7ec205bab57 req-abc44e4c-c283-4032-9c1e-f1a331fbd3ba service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:52.769218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-577dd8e4-8e57-46af-98a3-d7ec205bab57 req-abc44e4c-c283-4032-9c1e-f1a331fbd3ba service nova] Creating event network-vif-deleted:c920306a-84f5-4723-a57f-bb8dc17b0207 for instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 on hv-cinder-85394 Aug 22 17:34:52.776963 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-577dd8e4-8e57-46af-98a3-d7ec205bab57 req-abc44e4c-c283-4032-9c1e-f1a331fbd3ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064338 Aug 22 17:34:52.778897 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 370/739] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:34:53.285678 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-062ac4cb-b79c-4e76-bad0-153810175506 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:53.286606 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-062ac4cb-b79c-4e76-bad0-153810175506 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:53.295752 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-062ac4cb-b79c-4e76-bad0-153810175506 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:53.297125 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-062ac4cb-b79c-4e76-bad0-153810175506 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:53.297935 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-062ac4cb-b79c-4e76-bad0-153810175506 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:53.299111 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-062ac4cb-b79c-4e76-bad0-153810175506 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:53.300514 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-062ac4cb-b79c-4e76-bad0-153810175506 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:53.301181 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-062ac4cb-b79c-4e76-bad0-153810175506 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:53.422797 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-062ac4cb-b79c-4e76-bad0-153810175506 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:53.441451 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-062ac4cb-b79c-4e76-bad0-153810175506 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:53.447363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-062ac4cb-b79c-4e76-bad0-153810175506 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:53.452589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-062ac4cb-b79c-4e76-bad0-153810175506 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1338 microversion: 2.20 time: 0.168672 Aug 22 17:34:53.452589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 370/740] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:53 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1338 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:34:53.759663 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-fcc9af3d-57a8-401a-8c4e-6e6debba65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:53.762320 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-fcc9af3d-57a8-401a-8c4e-6e6debba65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:53.776839 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fcc9af3d-57a8-401a-8c4e-6e6debba65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:53.777716 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fcc9af3d-57a8-401a-8c4e-6e6debba65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:53.778547 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fcc9af3d-57a8-401a-8c4e-6e6debba65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:53.779867 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fcc9af3d-57a8-401a-8c4e-6e6debba65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:53.780712 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fcc9af3d-57a8-401a-8c4e-6e6debba65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:53.781470 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fcc9af3d-57a8-401a-8c4e-6e6debba65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:53.847362 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fcc9af3d-57a8-401a-8c4e-6e6debba65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:53.848203 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fcc9af3d-57a8-401a-8c4e-6e6debba65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:53.849412 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-fcc9af3d-57a8-401a-8c4e-6e6debba65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:53.850444 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-fcc9af3d-57a8-401a-8c4e-6e6debba65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lazy-loading 'fault' on Instance uuid 66347883-f0bf-4bbb-ba12-db82ee8d89c3 {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:34:53.911865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-fcc9af3d-57a8-401a-8c4e-6e6debba65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:53.928814 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-fcc9af3d-57a8-401a-8c4e-6e6debba65a3 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 200 len: 1335 microversion: 2.1 time: 0.181823 Aug 22 17:34:53.929893 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 371/741] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:53 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 1335 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:34:54.480595 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-665a1fe9-04b3-463b-a1d5-0399d41a5b7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:54.482782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-665a1fe9-04b3-463b-a1d5-0399d41a5b7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:54.508167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-665a1fe9-04b3-463b-a1d5-0399d41a5b7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:54.509450 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-665a1fe9-04b3-463b-a1d5-0399d41a5b7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:54.510657 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-665a1fe9-04b3-463b-a1d5-0399d41a5b7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:54.512060 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-665a1fe9-04b3-463b-a1d5-0399d41a5b7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:54.512822 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-665a1fe9-04b3-463b-a1d5-0399d41a5b7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:54.513589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-665a1fe9-04b3-463b-a1d5-0399d41a5b7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:54.766279 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-665a1fe9-04b3-463b-a1d5-0399d41a5b7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:54.778563 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-665a1fe9-04b3-463b-a1d5-0399d41a5b7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:54.781169 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-665a1fe9-04b3-463b-a1d5-0399d41a5b7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:54.782791 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-665a1fe9-04b3-463b-a1d5-0399d41a5b7a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1405 microversion: 2.20 time: 0.311997 Aug 22 17:34:54.783581 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 371/742] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:54 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1405 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:34:54.953078 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6498adc5-f6e5-46c9-9e8a-4c2e502fdcaf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:54.953715 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6498adc5-f6e5-46c9-9e8a-4c2e502fdcaf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66347883-f0bf-4bbb-ba12-db82ee8d89c3] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:54.963715 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6498adc5-f6e5-46c9-9e8a-4c2e502fdcaf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:54.964222 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6498adc5-f6e5-46c9-9e8a-4c2e502fdcaf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:54.964671 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6498adc5-f6e5-46c9-9e8a-4c2e502fdcaf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:54.965391 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6498adc5-f6e5-46c9-9e8a-4c2e502fdcaf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:54.965846 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6498adc5-f6e5-46c9-9e8a-4c2e502fdcaf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:54.966273 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6498adc5-f6e5-46c9-9e8a-4c2e502fdcaf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:54.983889 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-6498adc5-f6e5-46c9-9e8a-4c2e502fdcaf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] HTTP exception thrown: Instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 could not be found. Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6498adc5-f6e5-46c9-9e8a-4c2e502fdcaf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Request method failure captured: Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 HTTP/1.1 Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xXN8baaPK_MH4cED3CcghEWE-YceYDcUGSHqs14knAq32J1JqzpO0cyhzH_BH89JF7lD9EeFtriNkgpyiRD5SIvJiBn9c3eg-HMVaHqC4GnaFGBixvu6HvsWUG2lq4eV2Tb6cR5BguIlgiXJnd81Kk1-dMJMjSy3tqg7llKtV_pTM Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: de12c2563d50474cac799d50041a2fa0 Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:34:54.985825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:34:54.988865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de12c2563d50474cac799d50041a2fa0", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:34:54.988865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:34:54.988865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: de12c2563d50474cac799d50041a2fa0 Aug 22 17:34:54.988865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:34:54.988865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-ServerRescueNegativeTestJSON-1723447613-project Aug 22 17:34:54.988865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:34:54.988865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:34:54.988865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: f46cbc7de18c4f9fb6f54e96be53fea0 Aug 22 17:34:54.988865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1723447613-project Aug 22 17:34:54.988865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:34:54.988865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 could not be found. Aug 22 17:34:54.988865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '66347883-f0bf-4bbb-ba12-db82ee8d89c3'} Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 could not be found. Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:34:54.990418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 could not be found. Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 could not be found. Aug 22 17:34:54.994141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:34:54.996649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6498adc5-f6e5-46c9-9e8a-4c2e502fdcaf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Returning 404 to user: Instance 66347883-f0bf-4bbb-ba12-db82ee8d89c3 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:34:54.996649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6498adc5-f6e5-46c9-9e8a-4c2e502fdcaf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3" status: 404 len: 111 microversion: 2.1 time: 0.039479 Aug 22 17:34:54.996649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 372/743] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:54 2022] GET /compute/v2.1/servers/66347883-f0bf-4bbb-ba12-db82ee8d89c3 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:34:55.001072 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b9295901-7ace-4d58-bba6-f0be53c11a5e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '.version_select at 0x7f0e5c48bb80>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:55.141630 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b9295901-7ace-4d58-bba6-f0be53c11a5e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-526864827" status: 202 len: 0 microversion: 2.1 time: 0.145818 Aug 22 17:34:55.142352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 372/744] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 22 17:34:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-526864827 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:34:55.653017 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-13c4bf96-8624-4c67-86f6-c12e7bf7463f req-8aee0153-6a60-4ad5-b83b-84c504c6c4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a67bb4-4540-4e14-a7bc-74bf8ca080da", "tag": "c93f66cf-3a0a-41e2-a4a1-03d394f2cce2"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:34:55.674867 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-13c4bf96-8624-4c67-86f6-c12e7bf7463f req-8aee0153-6a60-4ad5-b83b-84c504c6c4f5 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:55.676396 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-13c4bf96-8624-4c67-86f6-c12e7bf7463f req-8aee0153-6a60-4ad5-b83b-84c504c6c4f5 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:55.688730 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-13c4bf96-8624-4c67-86f6-c12e7bf7463f req-8aee0153-6a60-4ad5-b83b-84c504c6c4f5 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:55.717352 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-13c4bf96-8624-4c67-86f6-c12e7bf7463f req-8aee0153-6a60-4ad5-b83b-84c504c6c4f5 service nova] Creating event network-changed:c93f66cf-3a0a-41e2-a4a1-03d394f2cce2 for instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da on hv-cinder-85394 Aug 22 17:34:55.730738 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-13c4bf96-8624-4c67-86f6-c12e7bf7463f req-8aee0153-6a60-4ad5-b83b-84c504c6c4f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085447 Aug 22 17:34:55.733110 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 373/745] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:34:55.819513 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=4 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:55.825843 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-995cc2ff-1796-47e0-94f7-7bb9df0887c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:55.826860 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-995cc2ff-1796-47e0-94f7-7bb9df0887c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:55.839883 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-995cc2ff-1796-47e0-94f7-7bb9df0887c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:55.840811 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-995cc2ff-1796-47e0-94f7-7bb9df0887c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:55.841747 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-995cc2ff-1796-47e0-94f7-7bb9df0887c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:55.842856 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-995cc2ff-1796-47e0-94f7-7bb9df0887c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:55.843562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-995cc2ff-1796-47e0-94f7-7bb9df0887c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:55.844199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-995cc2ff-1796-47e0-94f7-7bb9df0887c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:56.129511 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-995cc2ff-1796-47e0-94f7-7bb9df0887c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:56.144579 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-995cc2ff-1796-47e0-94f7-7bb9df0887c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:56.146233 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-995cc2ff-1796-47e0-94f7-7bb9df0887c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:56.147676 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-995cc2ff-1796-47e0-94f7-7bb9df0887c3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1405 microversion: 2.20 time: 0.329211 Aug 22 17:34:56.149292 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 373/746] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:55 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1405 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:34:57.173068 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8a937cdc-5b9a-4832-abe9-7ee586cc3552 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:57.173879 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8a937cdc-5b9a-4832-abe9-7ee586cc3552 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:57.182108 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a937cdc-5b9a-4832-abe9-7ee586cc3552 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:57.183036 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a937cdc-5b9a-4832-abe9-7ee586cc3552 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:57.183816 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a937cdc-5b9a-4832-abe9-7ee586cc3552 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:57.185186 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a937cdc-5b9a-4832-abe9-7ee586cc3552 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:57.186060 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a937cdc-5b9a-4832-abe9-7ee586cc3552 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:57.186891 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a937cdc-5b9a-4832-abe9-7ee586cc3552 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:57.374766 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8a937cdc-5b9a-4832-abe9-7ee586cc3552 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:57.392522 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8a937cdc-5b9a-4832-abe9-7ee586cc3552 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:57.395704 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8a937cdc-5b9a-4832-abe9-7ee586cc3552 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:57.398686 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8a937cdc-5b9a-4832-abe9-7ee586cc3552 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1405 microversion: 2.20 time: 0.229060 Aug 22 17:34:57.399738 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 374/747] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:57 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1405 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:34:58.435964 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a07c21d0-7285-40ad-8cca-7b82be029810 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:58.443707 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a07c21d0-7285-40ad-8cca-7b82be029810 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:58.444603 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a07c21d0-7285-40ad-8cca-7b82be029810 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:58.445932 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a07c21d0-7285-40ad-8cca-7b82be029810 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:58.446861 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a07c21d0-7285-40ad-8cca-7b82be029810 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:58.447715 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a07c21d0-7285-40ad-8cca-7b82be029810 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:58.448320 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a07c21d0-7285-40ad-8cca-7b82be029810 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:58.448978 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a07c21d0-7285-40ad-8cca-7b82be029810 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:58.639072 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a07c21d0-7285-40ad-8cca-7b82be029810 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:58.649472 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a07c21d0-7285-40ad-8cca-7b82be029810 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:58.654826 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a07c21d0-7285-40ad-8cca-7b82be029810 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:58.654826 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a07c21d0-7285-40ad-8cca-7b82be029810 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1405 microversion: 2.20 time: 0.221491 Aug 22 17:34:58.654826 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 374/748] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:58 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:34:59.229276 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-807ce08e-3eb4-41eb-b9e4-562e23f7aa6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:59.230148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-807ce08e-3eb4-41eb-b9e4-562e23f7aa6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:59.242245 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-807ce08e-3eb4-41eb-b9e4-562e23f7aa6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:59.243307 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-807ce08e-3eb4-41eb-b9e4-562e23f7aa6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:59.244041 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-807ce08e-3eb4-41eb-b9e4-562e23f7aa6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:59.245416 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-807ce08e-3eb4-41eb-b9e4-562e23f7aa6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:59.246129 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-807ce08e-3eb4-41eb-b9e4-562e23f7aa6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:59.246885 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-807ce08e-3eb4-41eb-b9e4-562e23f7aa6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:59.296884 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-807ce08e-3eb4-41eb-b9e4-562e23f7aa6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Going to try to terminate instance {{(pid=121852) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:34:59.599569 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:34:59.662829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-807ce08e-3eb4-41eb-b9e4-562e23f7aa6b tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "DELETE /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 204 len: 0 microversion: 2.1 time: 0.440895 Aug 22 17:34:59.663880 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 375/749] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:34:59 2022] DELETE /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:34:59.680967 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-3e47b02d-7d60-44cb-960e-3a7d56a29e4a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:59.683116 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-3e47b02d-7d60-44cb-960e-3a7d56a29e4a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:59.688525 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0e753501-ec96-4129-b96d-54e1340f6752 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:34:59.691538 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0e753501-ec96-4129-b96d-54e1340f6752 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:34:59.698879 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3e47b02d-7d60-44cb-960e-3a7d56a29e4a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:59.700590 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3e47b02d-7d60-44cb-960e-3a7d56a29e4a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:59.701679 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3e47b02d-7d60-44cb-960e-3a7d56a29e4a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:59.703321 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3e47b02d-7d60-44cb-960e-3a7d56a29e4a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:59.704499 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3e47b02d-7d60-44cb-960e-3a7d56a29e4a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:59.705517 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3e47b02d-7d60-44cb-960e-3a7d56a29e4a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:59.706171 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e753501-ec96-4129-b96d-54e1340f6752 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:59.707075 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e753501-ec96-4129-b96d-54e1340f6752 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:59.708112 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e753501-ec96-4129-b96d-54e1340f6752 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:59.709649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e753501-ec96-4129-b96d-54e1340f6752 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:34:59.711943 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e753501-ec96-4129-b96d-54e1340f6752 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:34:59.713562 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0e753501-ec96-4129-b96d-54e1340f6752 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:34:59.970901 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-3e47b02d-7d60-44cb-960e-3a7d56a29e4a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:59.986272 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0e753501-ec96-4129-b96d-54e1340f6752 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:34:59.992009 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-3e47b02d-7d60-44cb-960e-3a7d56a29e4a tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1508 microversion: 2.1 time: 0.316962 Aug 22 17:34:59.992009 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 375/750] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:34:59 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1508 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:00.006076 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0e753501-ec96-4129-b96d-54e1340f6752 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:00.009594 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0e753501-ec96-4129-b96d-54e1340f6752 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:00.012263 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0e753501-ec96-4129-b96d-54e1340f6752 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1405 microversion: 2.20 time: 0.332968 Aug 22 17:35:00.013233 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 376/751] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:34:59 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1405 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:35:00.080517 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-558dc852-db1e-4f3c-a171-5d0a63034b66 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:35:00.082871 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-558dc852-db1e-4f3c-a171-5d0a63034b66 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:00.090172 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-558dc852-db1e-4f3c-a171-5d0a63034b66 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:00.090841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-558dc852-db1e-4f3c-a171-5d0a63034b66 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:00.091383 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-558dc852-db1e-4f3c-a171-5d0a63034b66 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:00.092113 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-558dc852-db1e-4f3c-a171-5d0a63034b66 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:00.092574 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-558dc852-db1e-4f3c-a171-5d0a63034b66 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:00.093000 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-558dc852-db1e-4f3c-a171-5d0a63034b66 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:00.358835 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-558dc852-db1e-4f3c-a171-5d0a63034b66 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "POST /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/action" status: 202 len: 0 microversion: 2.1 time: 0.282412 Aug 22 17:35:00.359919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 376/752] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 22 17:35:00 2022] POST /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:35:00.369953 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-83b36b2c-e462-4e99-b526-bb46340568a9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:00.371031 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-83b36b2c-e462-4e99-b526-bb46340568a9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:00.378324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83b36b2c-e462-4e99-b526-bb46340568a9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:00.378881 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83b36b2c-e462-4e99-b526-bb46340568a9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:00.379363 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83b36b2c-e462-4e99-b526-bb46340568a9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:00.380094 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83b36b2c-e462-4e99-b526-bb46340568a9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:00.380554 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83b36b2c-e462-4e99-b526-bb46340568a9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:00.380980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-83b36b2c-e462-4e99-b526-bb46340568a9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:00.401123 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:35:00.578639 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-83b36b2c-e462-4e99-b526-bb46340568a9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:00.606337 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-83b36b2c-e462-4e99-b526-bb46340568a9 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1752 microversion: 2.1 time: 0.239009 Aug 22 17:35:00.607951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 377/753] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:00 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1752 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:01.028040 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-107aa7e3-8bd1-410f-9b19-455088b10301 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:01.030913 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-107aa7e3-8bd1-410f-9b19-455088b10301 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:01.043598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-107aa7e3-8bd1-410f-9b19-455088b10301 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:01.044654 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-107aa7e3-8bd1-410f-9b19-455088b10301 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:01.045536 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-107aa7e3-8bd1-410f-9b19-455088b10301 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:01.047222 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-107aa7e3-8bd1-410f-9b19-455088b10301 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:01.048206 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f5c317d4-7bd5-4929-a0c3-0276dce17fe7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:01.049222 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-107aa7e3-8bd1-410f-9b19-455088b10301 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:01.049773 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f5c317d4-7bd5-4929-a0c3-0276dce17fe7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:01.050403 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-107aa7e3-8bd1-410f-9b19-455088b10301 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:01.062899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f5c317d4-7bd5-4929-a0c3-0276dce17fe7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:01.064132 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f5c317d4-7bd5-4929-a0c3-0276dce17fe7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:01.065155 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f5c317d4-7bd5-4929-a0c3-0276dce17fe7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:01.066689 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f5c317d4-7bd5-4929-a0c3-0276dce17fe7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:01.067725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f5c317d4-7bd5-4929-a0c3-0276dce17fe7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:01.068343 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f5c317d4-7bd5-4929-a0c3-0276dce17fe7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:01.076762 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=14 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:35:01.338353 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-107aa7e3-8bd1-410f-9b19-455088b10301 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:01.357391 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-107aa7e3-8bd1-410f-9b19-455088b10301 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1508 microversion: 2.1 time: 0.339621 Aug 22 17:35:01.360028 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 377/754] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:01 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1508 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:01.437806 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f5c317d4-7bd5-4929-a0c3-0276dce17fe7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:01.455370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f5c317d4-7bd5-4929-a0c3-0276dce17fe7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:01.459069 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f5c317d4-7bd5-4929-a0c3-0276dce17fe7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:01.462113 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f5c317d4-7bd5-4929-a0c3-0276dce17fe7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1405 microversion: 2.20 time: 0.423479 Aug 22 17:35:01.463787 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 378/755] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:35:01 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:35:01.654149 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a130dfa3-0ed1-4f31-97be-ffbbd4e2c594 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:01.655340 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a130dfa3-0ed1-4f31-97be-ffbbd4e2c594 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:01.667332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a130dfa3-0ed1-4f31-97be-ffbbd4e2c594 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:01.669195 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a130dfa3-0ed1-4f31-97be-ffbbd4e2c594 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:01.669195 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a130dfa3-0ed1-4f31-97be-ffbbd4e2c594 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:01.670572 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a130dfa3-0ed1-4f31-97be-ffbbd4e2c594 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:01.671377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a130dfa3-0ed1-4f31-97be-ffbbd4e2c594 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:01.672195 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a130dfa3-0ed1-4f31-97be-ffbbd4e2c594 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:01.882973 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-e3fb92a9-ca59-4995-a456-3b2973de349a req-68bf842a-1c42-4447-914a-c76d76a66043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66262c8d-0245-4a3f-83e8-d3093c6d1057", "name": "network-vif-deleted", "tag": "162afc48-12ea-4a69-b48b-a1d677b0c796"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:35:01.893922 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-e3fb92a9-ca59-4995-a456-3b2973de349a req-68bf842a-1c42-4447-914a-c76d76a66043 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:01.894809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-e3fb92a9-ca59-4995-a456-3b2973de349a req-68bf842a-1c42-4447-914a-c76d76a66043 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:01.895354 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-e3fb92a9-ca59-4995-a456-3b2973de349a req-68bf842a-1c42-4447-914a-c76d76a66043 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:01.909320 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-e3fb92a9-ca59-4995-a456-3b2973de349a req-68bf842a-1c42-4447-914a-c76d76a66043 service nova] Creating event network-vif-deleted:162afc48-12ea-4a69-b48b-a1d677b0c796 for instance 66262c8d-0245-4a3f-83e8-d3093c6d1057 on hv-cinder-85394 Aug 22 17:35:01.917238 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-e3fb92a9-ca59-4995-a456-3b2973de349a req-68bf842a-1c42-4447-914a-c76d76a66043 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038291 Aug 22 17:35:01.918119 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 379/756] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:35:02.012127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a130dfa3-0ed1-4f31-97be-ffbbd4e2c594 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:02.024254 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a130dfa3-0ed1-4f31-97be-ffbbd4e2c594 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1752 microversion: 2.1 time: 0.378390 Aug 22 17:35:02.025906 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 378/757] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:01 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1752 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:02.232193 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-48e9f071-7171-44ed-99bd-3840b792f7ec req-21206d15-1676-4007-bfba-4edb5ab1bb4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a67bb4-4540-4e14-a7bc-74bf8ca080da", "name": "network-vif-plugged", "status": "completed", "tag": "c93f66cf-3a0a-41e2-a4a1-03d394f2cce2"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:35:02.243814 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-48e9f071-7171-44ed-99bd-3840b792f7ec req-21206d15-1676-4007-bfba-4edb5ab1bb4a service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:02.244841 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-48e9f071-7171-44ed-99bd-3840b792f7ec req-21206d15-1676-4007-bfba-4edb5ab1bb4a service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:02.245462 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-48e9f071-7171-44ed-99bd-3840b792f7ec req-21206d15-1676-4007-bfba-4edb5ab1bb4a service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:02.259932 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-48e9f071-7171-44ed-99bd-3840b792f7ec req-21206d15-1676-4007-bfba-4edb5ab1bb4a service nova] Creating event network-vif-plugged:c93f66cf-3a0a-41e2-a4a1-03d394f2cce2 for instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da on hv-cinder-85394 Aug 22 17:35:02.265642 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-48e9f071-7171-44ed-99bd-3840b792f7ec req-21206d15-1676-4007-bfba-4edb5ab1bb4a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037478 Aug 22 17:35:02.266282 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 380/758] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:35:02.394872 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a7bab48c-a436-4178-9b37-c418c1034057 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:02.395593 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a7bab48c-a436-4178-9b37-c418c1034057 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:02.406404 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7bab48c-a436-4178-9b37-c418c1034057 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:02.407318 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7bab48c-a436-4178-9b37-c418c1034057 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:02.408104 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7bab48c-a436-4178-9b37-c418c1034057 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:02.409367 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7bab48c-a436-4178-9b37-c418c1034057 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:02.410087 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7bab48c-a436-4178-9b37-c418c1034057 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:02.410684 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7bab48c-a436-4178-9b37-c418c1034057 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:02.467641 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7bab48c-a436-4178-9b37-c418c1034057 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:02.468262 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7bab48c-a436-4178-9b37-c418c1034057 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:02.468701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7bab48c-a436-4178-9b37-c418c1034057 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:02.469183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-a7bab48c-a436-4178-9b37-c418c1034057 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lazy-loading 'fault' on Instance uuid 66262c8d-0245-4a3f-83e8-d3093c6d1057 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:35:02.506946 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-548dff61-77cb-4b55-9cb1-a79180cf1dd5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:02.509015 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-548dff61-77cb-4b55-9cb1-a79180cf1dd5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:02.520273 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-548dff61-77cb-4b55-9cb1-a79180cf1dd5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:02.521228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-548dff61-77cb-4b55-9cb1-a79180cf1dd5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:02.522019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-548dff61-77cb-4b55-9cb1-a79180cf1dd5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:02.523938 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-548dff61-77cb-4b55-9cb1-a79180cf1dd5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:02.524801 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-548dff61-77cb-4b55-9cb1-a79180cf1dd5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:02.525558 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-548dff61-77cb-4b55-9cb1-a79180cf1dd5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:02.529359 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a7bab48c-a436-4178-9b37-c418c1034057 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:02.539978 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a7bab48c-a436-4178-9b37-c418c1034057 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 200 len: 1312 microversion: 2.1 time: 0.150148 Aug 22 17:35:02.540767 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 379/759] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:02 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:35:02.730827 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-548dff61-77cb-4b55-9cb1-a79180cf1dd5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:02.739978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-548dff61-77cb-4b55-9cb1-a79180cf1dd5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:02.742083 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-548dff61-77cb-4b55-9cb1-a79180cf1dd5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:02.743956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-548dff61-77cb-4b55-9cb1-a79180cf1dd5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1405 microversion: 2.20 time: 0.245174 Aug 22 17:35:02.744554 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 381/760] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:35:02 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1405 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:35:03.049674 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b11bd3ed-a0ec-431a-89ae-3b175a6940ec tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:03.050522 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b11bd3ed-a0ec-431a-89ae-3b175a6940ec tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:03.058810 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b11bd3ed-a0ec-431a-89ae-3b175a6940ec tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:03.059608 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b11bd3ed-a0ec-431a-89ae-3b175a6940ec tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:03.059939 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b11bd3ed-a0ec-431a-89ae-3b175a6940ec tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:03.060690 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b11bd3ed-a0ec-431a-89ae-3b175a6940ec tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:03.061247 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b11bd3ed-a0ec-431a-89ae-3b175a6940ec tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:03.061718 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b11bd3ed-a0ec-431a-89ae-3b175a6940ec tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:03.242474 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b11bd3ed-a0ec-431a-89ae-3b175a6940ec tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:03.252138 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b11bd3ed-a0ec-431a-89ae-3b175a6940ec tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1757 microversion: 2.1 time: 0.206379 Aug 22 17:35:03.252793 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 380/761] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:03 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1757 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:03.562655 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5af4a746-72af-46ff-8b34-c7c96b8a6b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:03.563336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5af4a746-72af-46ff-8b34-c7c96b8a6b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: 66262c8d-0245-4a3f-83e8-d3093c6d1057] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:03.572328 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5af4a746-72af-46ff-8b34-c7c96b8a6b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:03.572829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5af4a746-72af-46ff-8b34-c7c96b8a6b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:03.573271 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5af4a746-72af-46ff-8b34-c7c96b8a6b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:03.573985 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5af4a746-72af-46ff-8b34-c7c96b8a6b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:03.575355 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5af4a746-72af-46ff-8b34-c7c96b8a6b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:03.575795 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5af4a746-72af-46ff-8b34-c7c96b8a6b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:03.592854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-5af4a746-72af-46ff-8b34-c7c96b8a6b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] HTTP exception thrown: Instance 66262c8d-0245-4a3f-83e8-d3093c6d1057 could not be found. Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5af4a746-72af-46ff-8b34-c7c96b8a6b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Request method failure captured: Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 HTTP/1.1 Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xXN8baaPK_MH4cED3CcghEWE-YceYDcUGSHqs14knAq32J1JqzpO0cyhzH_BH89JF7lD9EeFtriNkgpyiRD5SIvJiBn9c3eg-HMVaHqC4GnaFGBixvu6HvsWUG2lq4eV2Tb6cR5BguIlgiXJnd81Kk1-dMJMjSy3tqg7llKtV_pTM Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: de12c2563d50474cac799d50041a2fa0 Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:35:03.594597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:35:03.597705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de12c2563d50474cac799d50041a2fa0", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:35:03.597705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:35:03.597705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: de12c2563d50474cac799d50041a2fa0 Aug 22 17:35:03.597705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:35:03.597705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-ServerRescueNegativeTestJSON-1723447613-project Aug 22 17:35:03.597705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:35:03.597705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:35:03.597705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: f46cbc7de18c4f9fb6f54e96be53fea0 Aug 22 17:35:03.597705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1723447613-project Aug 22 17:35:03.597705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:35:03.597705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance 66262c8d-0245-4a3f-83e8-d3093c6d1057 could not be found. Aug 22 17:35:03.597705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '66262c8d-0245-4a3f-83e8-d3093c6d1057'} Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66262c8d-0245-4a3f-83e8-d3093c6d1057 could not be found. Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:35:03.599385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66262c8d-0245-4a3f-83e8-d3093c6d1057 could not be found. Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66262c8d-0245-4a3f-83e8-d3093c6d1057 could not be found. Aug 22 17:35:03.602174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:35:03.605404 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5af4a746-72af-46ff-8b34-c7c96b8a6b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Returning 404 to user: Instance 66262c8d-0245-4a3f-83e8-d3093c6d1057 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:35:03.605404 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5af4a746-72af-46ff-8b34-c7c96b8a6b4e tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057" status: 404 len: 111 microversion: 2.1 time: 0.038020 Aug 22 17:35:03.605404 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 382/762] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:03 2022] GET /compute/v2.1/servers/66262c8d-0245-4a3f-83e8-d3093c6d1057 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:35:03.607349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-016914b7-a94c-477b-98ac-cc6cd3422a0d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:03.608081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-016914b7-a94c-477b-98ac-cc6cd3422a0d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:03.614240 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-016914b7-a94c-477b-98ac-cc6cd3422a0d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:03.614844 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-016914b7-a94c-477b-98ac-cc6cd3422a0d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:03.615494 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-016914b7-a94c-477b-98ac-cc6cd3422a0d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:03.616249 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-016914b7-a94c-477b-98ac-cc6cd3422a0d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:03.617183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-016914b7-a94c-477b-98ac-cc6cd3422a0d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:03.617609 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-016914b7-a94c-477b-98ac-cc6cd3422a0d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:03.647332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-016914b7-a94c-477b-98ac-cc6cd3422a0d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Going to try to terminate instance {{(pid=121853) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:35:03.770030 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-04d07495-393b-43e2-872d-aad02258fc43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:03.770845 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-04d07495-393b-43e2-872d-aad02258fc43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:03.777522 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-04d07495-393b-43e2-872d-aad02258fc43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:03.781177 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-04d07495-393b-43e2-872d-aad02258fc43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:03.781177 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-04d07495-393b-43e2-872d-aad02258fc43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:03.781177 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-04d07495-393b-43e2-872d-aad02258fc43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:03.781177 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-04d07495-393b-43e2-872d-aad02258fc43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:03.781900 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-04d07495-393b-43e2-872d-aad02258fc43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:03.941396 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-04d07495-393b-43e2-872d-aad02258fc43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:03.952401 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-04d07495-393b-43e2-872d-aad02258fc43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:03.953961 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-04d07495-393b-43e2-872d-aad02258fc43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:03.955153 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-04d07495-393b-43e2-872d-aad02258fc43 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1405 microversion: 2.20 time: 0.189222 Aug 22 17:35:03.955727 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 383/763] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:35:03 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:35:03.971616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-016914b7-a94c-477b-98ac-cc6cd3422a0d tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 204 len: 0 microversion: 2.1 time: 0.369484 Aug 22 17:35:03.977084 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 381/764] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:35:03 2022] DELETE /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:35:03.984665 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a6bcf28f-bc42-4a23-90ee-c141585ac059 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:03.985469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a6bcf28f-bc42-4a23-90ee-c141585ac059 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:03.993138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6bcf28f-bc42-4a23-90ee-c141585ac059 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:03.993780 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6bcf28f-bc42-4a23-90ee-c141585ac059 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:03.994326 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6bcf28f-bc42-4a23-90ee-c141585ac059 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:03.995191 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6bcf28f-bc42-4a23-90ee-c141585ac059 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:03.995751 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6bcf28f-bc42-4a23-90ee-c141585ac059 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:03.996428 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6bcf28f-bc42-4a23-90ee-c141585ac059 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:04.144870 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a6bcf28f-bc42-4a23-90ee-c141585ac059 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:04.154429 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a6bcf28f-bc42-4a23-90ee-c141585ac059 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.173627 Aug 22 17:35:04.155073 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 384/765] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:03 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:35:04.277140 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a52a408d-8f2f-4b07-9efc-ebe74d6b81a0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:04.278001 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a52a408d-8f2f-4b07-9efc-ebe74d6b81a0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:04.285895 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a52a408d-8f2f-4b07-9efc-ebe74d6b81a0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:04.286401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a52a408d-8f2f-4b07-9efc-ebe74d6b81a0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:04.286874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a52a408d-8f2f-4b07-9efc-ebe74d6b81a0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:04.287626 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a52a408d-8f2f-4b07-9efc-ebe74d6b81a0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:04.288086 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a52a408d-8f2f-4b07-9efc-ebe74d6b81a0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:04.289116 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a52a408d-8f2f-4b07-9efc-ebe74d6b81a0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:04.479763 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a52a408d-8f2f-4b07-9efc-ebe74d6b81a0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:04.488997 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a52a408d-8f2f-4b07-9efc-ebe74d6b81a0 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1757 microversion: 2.1 time: 0.217521 Aug 22 17:35:04.489597 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 382/766] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:04 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1757 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:04.979819 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3d38b9b1-8157-44ec-ad6f-b49795798ed2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:04.980533 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3d38b9b1-8157-44ec-ad6f-b49795798ed2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:04.987606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3d38b9b1-8157-44ec-ad6f-b49795798ed2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:04.988097 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3d38b9b1-8157-44ec-ad6f-b49795798ed2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:04.988531 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3d38b9b1-8157-44ec-ad6f-b49795798ed2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:04.989235 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3d38b9b1-8157-44ec-ad6f-b49795798ed2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:04.989686 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3d38b9b1-8157-44ec-ad6f-b49795798ed2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:04.990102 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3d38b9b1-8157-44ec-ad6f-b49795798ed2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:05.176849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-63f12954-7c80-4ea8-a969-48cd9e1600fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:05.177557 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-63f12954-7c80-4ea8-a969-48cd9e1600fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:05.186472 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-63f12954-7c80-4ea8-a969-48cd9e1600fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:05.186987 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-63f12954-7c80-4ea8-a969-48cd9e1600fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:05.187420 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-63f12954-7c80-4ea8-a969-48cd9e1600fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:05.188118 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-63f12954-7c80-4ea8-a969-48cd9e1600fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:05.188572 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-63f12954-7c80-4ea8-a969-48cd9e1600fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:05.188996 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-63f12954-7c80-4ea8-a969-48cd9e1600fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:05.199683 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3d38b9b1-8157-44ec-ad6f-b49795798ed2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:05.211885 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3d38b9b1-8157-44ec-ad6f-b49795798ed2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:05.215027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3d38b9b1-8157-44ec-ad6f-b49795798ed2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:05.217000 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3d38b9b1-8157-44ec-ad6f-b49795798ed2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1405 microversion: 2.20 time: 0.241718 Aug 22 17:35:05.217940 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 385/767] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:35:04 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1405 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:35:05.358084 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-63f12954-7c80-4ea8-a969-48cd9e1600fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:05.367350 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-63f12954-7c80-4ea8-a969-48cd9e1600fd tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.194140 Aug 22 17:35:05.368178 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 383/768] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:05 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:35:05.515689 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f51cb94d-dfa2-4b20-9c28-2d1d03c56943 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:05.516487 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f51cb94d-dfa2-4b20-9c28-2d1d03c56943 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:05.524735 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f51cb94d-dfa2-4b20-9c28-2d1d03c56943 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:05.525380 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f51cb94d-dfa2-4b20-9c28-2d1d03c56943 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:05.525897 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f51cb94d-dfa2-4b20-9c28-2d1d03c56943 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:05.526784 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f51cb94d-dfa2-4b20-9c28-2d1d03c56943 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:05.527287 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f51cb94d-dfa2-4b20-9c28-2d1d03c56943 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:05.527811 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f51cb94d-dfa2-4b20-9c28-2d1d03c56943 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:05.705562 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f51cb94d-dfa2-4b20-9c28-2d1d03c56943 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:05.715875 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f51cb94d-dfa2-4b20-9c28-2d1d03c56943 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1757 microversion: 2.1 time: 0.205017 Aug 22 17:35:05.716538 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 386/769] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:05 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1757 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:35:06.243513 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-aa5cfcab-6743-4be5-9b23-0fca5d571686 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:06.244506 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-aa5cfcab-6743-4be5-9b23-0fca5d571686 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:06.252216 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aa5cfcab-6743-4be5-9b23-0fca5d571686 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:06.252976 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aa5cfcab-6743-4be5-9b23-0fca5d571686 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:06.253548 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aa5cfcab-6743-4be5-9b23-0fca5d571686 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:06.254403 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aa5cfcab-6743-4be5-9b23-0fca5d571686 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:06.254955 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aa5cfcab-6743-4be5-9b23-0fca5d571686 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:06.255437 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aa5cfcab-6743-4be5-9b23-0fca5d571686 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:06.277742 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:35:06.390658 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f6e0ba66-e295-4675-85f5-bdbd9912b1bf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:06.392095 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f6e0ba66-e295-4675-85f5-bdbd9912b1bf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:06.401423 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f6e0ba66-e295-4675-85f5-bdbd9912b1bf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:06.402340 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f6e0ba66-e295-4675-85f5-bdbd9912b1bf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:06.402974 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f6e0ba66-e295-4675-85f5-bdbd9912b1bf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:06.404148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f6e0ba66-e295-4675-85f5-bdbd9912b1bf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:06.404896 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f6e0ba66-e295-4675-85f5-bdbd9912b1bf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:06.405532 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f6e0ba66-e295-4675-85f5-bdbd9912b1bf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:06.458466 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-aa5cfcab-6743-4be5-9b23-0fca5d571686 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:06.474043 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-aa5cfcab-6743-4be5-9b23-0fca5d571686 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:06.477102 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-aa5cfcab-6743-4be5-9b23-0fca5d571686 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:06.479270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-aa5cfcab-6743-4be5-9b23-0fca5d571686 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1596 microversion: 2.20 time: 0.241558 Aug 22 17:35:06.480269 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 384/770] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:35:06 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1596 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:35:06.518366 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-34955aae-79e9-4291-a598-001ffe456dc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:06.519261 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-34955aae-79e9-4291-a598-001ffe456dc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:06.530424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-34955aae-79e9-4291-a598-001ffe456dc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:06.531299 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-34955aae-79e9-4291-a598-001ffe456dc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:06.531901 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-34955aae-79e9-4291-a598-001ffe456dc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:06.532670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-34955aae-79e9-4291-a598-001ffe456dc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:06.533364 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-34955aae-79e9-4291-a598-001ffe456dc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:06.533990 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-34955aae-79e9-4291-a598-001ffe456dc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:06.639605 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-34955aae-79e9-4291-a598-001ffe456dc1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.128242 Aug 22 17:35:06.640694 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 385/771] 10.222.0.20 () {60 vars in 1316 bytes} [Mon Aug 22 17:35:06 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:35:06.641856 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f6e0ba66-e295-4675-85f5-bdbd9912b1bf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:06.652770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f6e0ba66-e295-4675-85f5-bdbd9912b1bf tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1520 microversion: 2.1 time: 0.266478 Aug 22 17:35:06.654284 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 387/772] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:06 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1520 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:35:06.738926 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5c3f679a-8e3d-4d58-a6b7-ec604ba68e74 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:06.739557 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5c3f679a-8e3d-4d58-a6b7-ec604ba68e74 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:06.746747 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c3f679a-8e3d-4d58-a6b7-ec604ba68e74 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:06.750202 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c3f679a-8e3d-4d58-a6b7-ec604ba68e74 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:06.750202 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c3f679a-8e3d-4d58-a6b7-ec604ba68e74 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:06.750202 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c3f679a-8e3d-4d58-a6b7-ec604ba68e74 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:06.750202 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c3f679a-8e3d-4d58-a6b7-ec604ba68e74 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:06.750951 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c3f679a-8e3d-4d58-a6b7-ec604ba68e74 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:06.942264 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-88400141-b31f-4cf9-85ea-b2484652bee8 req-7dbbe7a3-de69-441e-832a-a7f39e1017f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4763726-f1d6-476a-b919-ad30acd9fcc4", "name": "network-vif-deleted", "tag": "0dda04d1-36ae-4c21-ac5d-063913579bea"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:35:06.971721 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-88400141-b31f-4cf9-85ea-b2484652bee8 req-7dbbe7a3-de69-441e-832a-a7f39e1017f0 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:06.972967 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-88400141-b31f-4cf9-85ea-b2484652bee8 req-7dbbe7a3-de69-441e-832a-a7f39e1017f0 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:06.973946 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-88400141-b31f-4cf9-85ea-b2484652bee8 req-7dbbe7a3-de69-441e-832a-a7f39e1017f0 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:07.002011 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-88400141-b31f-4cf9-85ea-b2484652bee8 req-7dbbe7a3-de69-441e-832a-a7f39e1017f0 service nova] Creating event network-vif-deleted:0dda04d1-36ae-4c21-ac5d-063913579bea for instance e4763726-f1d6-476a-b919-ad30acd9fcc4 on hv-cinder-85394 Aug 22 17:35:07.012794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-88400141-b31f-4cf9-85ea-b2484652bee8 req-7dbbe7a3-de69-441e-832a-a7f39e1017f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094791 Aug 22 17:35:07.015061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 388/773] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:35:07.019837 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5c3f679a-8e3d-4d58-a6b7-ec604ba68e74 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:07.034890 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5c3f679a-8e3d-4d58-a6b7-ec604ba68e74 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1757 microversion: 2.1 time: 0.299249 Aug 22 17:35:07.037376 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 386/774] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:06 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1757 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:07.690944 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6d6ecf04-390f-4b7a-a9f9-252387d2bd61 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:07.691837 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6d6ecf04-390f-4b7a-a9f9-252387d2bd61 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:07.704323 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d6ecf04-390f-4b7a-a9f9-252387d2bd61 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:07.705234 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d6ecf04-390f-4b7a-a9f9-252387d2bd61 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:07.706119 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d6ecf04-390f-4b7a-a9f9-252387d2bd61 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:07.707167 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d6ecf04-390f-4b7a-a9f9-252387d2bd61 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:07.709699 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d6ecf04-390f-4b7a-a9f9-252387d2bd61 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:07.709699 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d6ecf04-390f-4b7a-a9f9-252387d2bd61 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:07.751193 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d6ecf04-390f-4b7a-a9f9-252387d2bd61 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:07.751716 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d6ecf04-390f-4b7a-a9f9-252387d2bd61 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:07.752165 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6d6ecf04-390f-4b7a-a9f9-252387d2bd61 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:07.752630 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-6d6ecf04-390f-4b7a-a9f9-252387d2bd61 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lazy-loading 'fault' on Instance uuid e4763726-f1d6-476a-b919-ad30acd9fcc4 {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:35:07.813432 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6d6ecf04-390f-4b7a-a9f9-252387d2bd61 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f46cbc7de18c4f9fb6f54e96be53fea0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de12c2563d50474cac799d50041a2fa0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:07.823056 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6d6ecf04-390f-4b7a-a9f9-252387d2bd61 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 200 len: 1310 microversion: 2.1 time: 0.140225 Aug 22 17:35:07.823923 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 389/775] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:07 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 1310 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:08.065176 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0759ae3b-c916-41ba-b226-eed26dc12e39 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:08.066214 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0759ae3b-c916-41ba-b226-eed26dc12e39 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:08.076424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0759ae3b-c916-41ba-b226-eed26dc12e39 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:08.078930 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0759ae3b-c916-41ba-b226-eed26dc12e39 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:08.078930 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0759ae3b-c916-41ba-b226-eed26dc12e39 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:08.078930 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0759ae3b-c916-41ba-b226-eed26dc12e39 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:08.079294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0759ae3b-c916-41ba-b226-eed26dc12e39 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:08.080244 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0759ae3b-c916-41ba-b226-eed26dc12e39 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:08.320978 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0759ae3b-c916-41ba-b226-eed26dc12e39 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:08.334373 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0759ae3b-c916-41ba-b226-eed26dc12e39 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1757 microversion: 2.1 time: 0.277885 Aug 22 17:35:08.335885 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 387/776] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:08 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1757 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:08.853187 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6ef92255-eb90-45c9-8dbb-7c1431a85a54 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:08.855248 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6ef92255-eb90-45c9-8dbb-7c1431a85a54 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] [instance: e4763726-f1d6-476a-b919-ad30acd9fcc4] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:08.865877 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6ef92255-eb90-45c9-8dbb-7c1431a85a54 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:08.867207 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6ef92255-eb90-45c9-8dbb-7c1431a85a54 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:08.868093 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6ef92255-eb90-45c9-8dbb-7c1431a85a54 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:08.868956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6ef92255-eb90-45c9-8dbb-7c1431a85a54 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:08.869528 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6ef92255-eb90-45c9-8dbb-7c1431a85a54 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:08.870098 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6ef92255-eb90-45c9-8dbb-7c1431a85a54 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:08.888148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-6ef92255-eb90-45c9-8dbb-7c1431a85a54 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] HTTP exception thrown: Instance e4763726-f1d6-476a-b919-ad30acd9fcc4 could not be found. Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6ef92255-eb90-45c9-8dbb-7c1431a85a54 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Request method failure captured: Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 HTTP/1.1 Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xXN8baaPK_MH4cED3CcghEWE-YceYDcUGSHqs14knAq32J1JqzpO0cyhzH_BH89JF7lD9EeFtriNkgpyiRD5SIvJiBn9c3eg-HMVaHqC4GnaFGBixvu6HvsWUG2lq4eV2Tb6cR5BguIlgiXJnd81Kk1-dMJMjSy3tqg7llKtV_pTM Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: de12c2563d50474cac799d50041a2fa0 Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:35:08.890174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:35:08.893101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/de12c2563d50474cac799d50041a2fa0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_de12c2563d50474cac799d50041a2fa0", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:35:08.893101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:35:08.893101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: de12c2563d50474cac799d50041a2fa0 Aug 22 17:35:08.893101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1723447613 Aug 22 17:35:08.893101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-ServerRescueNegativeTestJSON-1723447613-project Aug 22 17:35:08.893101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:35:08.893101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:35:08.893101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: f46cbc7de18c4f9fb6f54e96be53fea0 Aug 22 17:35:08.893101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1723447613-project Aug 22 17:35:08.893101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:35:08.893101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance e4763726-f1d6-476a-b919-ad30acd9fcc4 could not be found. Aug 22 17:35:08.893101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': 'e4763726-f1d6-476a-b919-ad30acd9fcc4'} Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4763726-f1d6-476a-b919-ad30acd9fcc4 could not be found. Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:35:08.894759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4763726-f1d6-476a-b919-ad30acd9fcc4 could not be found. Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4763726-f1d6-476a-b919-ad30acd9fcc4 could not be found. Aug 22 17:35:08.898002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:35:08.900751 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6ef92255-eb90-45c9-8dbb-7c1431a85a54 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] Returning 404 to user: Instance e4763726-f1d6-476a-b919-ad30acd9fcc4 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:35:08.900751 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6ef92255-eb90-45c9-8dbb-7c1431a85a54 tempest-ServerRescueNegativeTestJSON-1723447613 tempest-ServerRescueNegativeTestJSON-1723447613-project] 10.222.0.20 "GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4" status: 404 len: 111 microversion: 2.1 time: 0.046974 Aug 22 17:35:08.903572 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 390/777] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:08 2022] GET /compute/v2.1/servers/e4763726-f1d6-476a-b919-ad30acd9fcc4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:35:09.035093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-6e56e749-8009-4b89-9d33-1e73ff8bcb51 req-3c60aaeb-10a5-4a95-8ca5-18834800beca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01a67bb4-4540-4e14-a7bc-74bf8ca080da", "tag": "c93f66cf-3a0a-41e2-a4a1-03d394f2cce2"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:35:09.047915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-6e56e749-8009-4b89-9d33-1e73ff8bcb51 req-3c60aaeb-10a5-4a95-8ca5-18834800beca service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:09.048504 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-6e56e749-8009-4b89-9d33-1e73ff8bcb51 req-3c60aaeb-10a5-4a95-8ca5-18834800beca service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:09.048944 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-6e56e749-8009-4b89-9d33-1e73ff8bcb51 req-3c60aaeb-10a5-4a95-8ca5-18834800beca service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:09.067602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-6e56e749-8009-4b89-9d33-1e73ff8bcb51 req-3c60aaeb-10a5-4a95-8ca5-18834800beca service nova] Creating event network-changed:c93f66cf-3a0a-41e2-a4a1-03d394f2cce2 for instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da on hv-cinder-85394 Aug 22 17:35:09.076273 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-6e56e749-8009-4b89-9d33-1e73ff8bcb51 req-3c60aaeb-10a5-4a95-8ca5-18834800beca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045357 Aug 22 17:35:09.077368 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 388/778] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:35:09.367250 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-43d1ea43-8790-4633-bca6-cbb4001c2aa2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:09.369159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-43d1ea43-8790-4633-bca6-cbb4001c2aa2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:09.384231 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-43d1ea43-8790-4633-bca6-cbb4001c2aa2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:09.385020 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-43d1ea43-8790-4633-bca6-cbb4001c2aa2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:09.385751 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-43d1ea43-8790-4633-bca6-cbb4001c2aa2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:09.386967 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-43d1ea43-8790-4633-bca6-cbb4001c2aa2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:09.396432 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-43d1ea43-8790-4633-bca6-cbb4001c2aa2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:09.397193 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-43d1ea43-8790-4633-bca6-cbb4001c2aa2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:09.873817 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-43d1ea43-8790-4633-bca6-cbb4001c2aa2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:09.888504 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-43d1ea43-8790-4633-bca6-cbb4001c2aa2 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1757 microversion: 2.1 time: 0.530299 Aug 22 17:35:09.889860 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 391/779] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:09 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1757 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:10.923609 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-21b86bc9-a166-4526-b6b7-74d8d6c67d06 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:10.924742 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-21b86bc9-a166-4526-b6b7-74d8d6c67d06 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:10.933564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21b86bc9-a166-4526-b6b7-74d8d6c67d06 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:10.934137 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21b86bc9-a166-4526-b6b7-74d8d6c67d06 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:10.934898 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21b86bc9-a166-4526-b6b7-74d8d6c67d06 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:10.935831 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21b86bc9-a166-4526-b6b7-74d8d6c67d06 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:10.936582 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21b86bc9-a166-4526-b6b7-74d8d6c67d06 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:10.937291 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21b86bc9-a166-4526-b6b7-74d8d6c67d06 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:11.148979 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-21b86bc9-a166-4526-b6b7-74d8d6c67d06 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:11.166297 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-21b86bc9-a166-4526-b6b7-74d8d6c67d06 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1757 microversion: 2.1 time: 0.248533 Aug 22 17:35:11.167432 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 389/780] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:10 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1757 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:35:11.735706 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-297860436", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-567724700", "security_groups": [{"name": "tempest-secgroup-smoke-1067862503"}], "block_device_mapping_v2": [{"uuid": "f1950448-aefb-4172-94e1-5be74a5d6a21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e1445a90-112c-40f4-a9b4-b117c3489d79"}]}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:35:11.936018 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.network.neutron [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] validate_networks() for [('e1445a90-112c-40f4-a9b4-b117c3489d79', None, None, None, None, None)] {{(pid=121852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:35:12.189819 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b52215d9-c92e-4798-9b1c-251e8d3357ac tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:12.195012 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b52215d9-c92e-4798-9b1c-251e8d3357ac tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:12.198235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b52215d9-c92e-4798-9b1c-251e8d3357ac tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:12.202421 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b52215d9-c92e-4798-9b1c-251e8d3357ac tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:12.202421 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b52215d9-c92e-4798-9b1c-251e8d3357ac tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:12.202421 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b52215d9-c92e-4798-9b1c-251e8d3357ac tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:12.202421 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b52215d9-c92e-4798-9b1c-251e8d3357ac tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:12.203585 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b52215d9-c92e-4798-9b1c-251e8d3357ac tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:12.523408 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:35:12.545424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Mon Aug 22 17:35:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 (ip 10.222.0.20) !!! Aug 22 17:35:12.617043 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Flavor limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:35:12.617841 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Image limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:35:12.618739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Flavor pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:35:12.620255 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Image pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:35:12.621034 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:35:12.639260 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:12.639806 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:12.640664 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:12.641702 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:12.642565 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:12.643958 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:12.650796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b52215d9-c92e-4798-9b1c-251e8d3357ac tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:12.667281 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b52215d9-c92e-4798-9b1c-251e8d3357ac tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1757 microversion: 2.1 time: 0.480903 Aug 22 17:35:12.668586 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 390/781] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:12 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1757 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:35:12.690699 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Getting quotas for project 43d4499a9d9f4c00a09c867bb403dd30. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:35:12.696317 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Getting quotas for user aa55b9fade0047c68c2f3f6bf4dfe44e and project 43d4499a9d9f4c00a09c867bb403dd30. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:35:12.792186 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Going to run 1 instances... {{(pid=121852) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:35:12.796895 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1950448-aefb-4172-94e1-5be74a5d6a21',volume_size=None,volume_type=None)] {{(pid=121852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:35:13.428794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c6725ab5-4c8d-4c59-9d20-74069143f71e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.696362 Aug 22 17:35:13.429756 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 392/782] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:35:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:35:13.447738 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c8840e42-4447-41b2-941f-30b1c315451c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:13.450008 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c8840e42-4447-41b2-941f-30b1c315451c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:13.665881 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c8840e42-4447-41b2-941f-30b1c315451c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:13.683267 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c8840e42-4447-41b2-941f-30b1c315451c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1093 microversion: 2.1 time: 0.241365 Aug 22 17:35:13.684355 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 391/783] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:13 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1093 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:13.708011 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-34841530-b4d2-4298-8fe9-7010b2df707b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:13.710767 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-34841530-b4d2-4298-8fe9-7010b2df707b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:13.721495 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34841530-b4d2-4298-8fe9-7010b2df707b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:13.722429 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34841530-b4d2-4298-8fe9-7010b2df707b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:13.723016 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34841530-b4d2-4298-8fe9-7010b2df707b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:13.723943 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34841530-b4d2-4298-8fe9-7010b2df707b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:13.724505 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34841530-b4d2-4298-8fe9-7010b2df707b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:13.725025 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34841530-b4d2-4298-8fe9-7010b2df707b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:14.040311 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-34841530-b4d2-4298-8fe9-7010b2df707b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:14.051456 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-34841530-b4d2-4298-8fe9-7010b2df707b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1760 microversion: 2.1 time: 0.352633 Aug 22 17:35:14.058116 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 393/784] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:13 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1760 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:14.723176 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-972e638e-bd4a-4f29-b1b5-931feaa0bc73 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:14.724023 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-972e638e-bd4a-4f29-b1b5-931feaa0bc73 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:14.886246 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-972e638e-bd4a-4f29-b1b5-931feaa0bc73 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:14.901863 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-972e638e-bd4a-4f29-b1b5-931feaa0bc73 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1093 microversion: 2.1 time: 0.187578 Aug 22 17:35:14.903382 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 392/785] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:14 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1093 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:15.938278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2d8a2efb-427f-4493-9a11-1cded389cfca tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:15.939961 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-2d8a2efb-427f-4493-9a11-1cded389cfca tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:15.949315 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2d8a2efb-427f-4493-9a11-1cded389cfca tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:15.950072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2d8a2efb-427f-4493-9a11-1cded389cfca tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:15.950726 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2d8a2efb-427f-4493-9a11-1cded389cfca tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:15.954116 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2d8a2efb-427f-4493-9a11-1cded389cfca tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:15.954576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2d8a2efb-427f-4493-9a11-1cded389cfca tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:15.955659 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2d8a2efb-427f-4493-9a11-1cded389cfca tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:16.025871 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2d8a2efb-427f-4493-9a11-1cded389cfca tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:16.041251 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2d8a2efb-427f-4493-9a11-1cded389cfca tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1191 microversion: 2.1 time: 0.107586 Aug 22 17:35:16.042334 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 394/786] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:15 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1191 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:17.079024 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6ea433b9-6fbd-418e-a329-8b5bd4725387 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:17.081702 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6ea433b9-6fbd-418e-a329-8b5bd4725387 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:17.105923 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6ea433b9-6fbd-418e-a329-8b5bd4725387 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:17.108777 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6ea433b9-6fbd-418e-a329-8b5bd4725387 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:17.109365 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6ea433b9-6fbd-418e-a329-8b5bd4725387 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:17.110720 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6ea433b9-6fbd-418e-a329-8b5bd4725387 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:17.111415 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6ea433b9-6fbd-418e-a329-8b5bd4725387 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:17.111975 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6ea433b9-6fbd-418e-a329-8b5bd4725387 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:17.196366 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6ea433b9-6fbd-418e-a329-8b5bd4725387 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:17.215677 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6ea433b9-6fbd-418e-a329-8b5bd4725387 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1209 microversion: 2.1 time: 0.153895 Aug 22 17:35:17.216702 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 393/787] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:17 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1209 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:18.244328 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-7648e3a3-6e21-4e6c-a597-f9a878473c8a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:18.245839 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-7648e3a3-6e21-4e6c-a597-f9a878473c8a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:18.254074 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7648e3a3-6e21-4e6c-a597-f9a878473c8a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:18.254778 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7648e3a3-6e21-4e6c-a597-f9a878473c8a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:18.255172 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7648e3a3-6e21-4e6c-a597-f9a878473c8a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:18.258436 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7648e3a3-6e21-4e6c-a597-f9a878473c8a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:18.258436 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7648e3a3-6e21-4e6c-a597-f9a878473c8a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:18.258436 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7648e3a3-6e21-4e6c-a597-f9a878473c8a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:18.643497 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-7648e3a3-6e21-4e6c-a597-f9a878473c8a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:18.658041 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-7648e3a3-6e21-4e6c-a597-f9a878473c8a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1277 microversion: 2.1 time: 0.419249 Aug 22 17:35:18.659590 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 395/788] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:18 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1277 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:19.204959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-8fe17b6b-99a2-410a-a9c0-c30a905492d8 req-3d218d15-d6e2-40c5-aad2-9b6631c76cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da", "tag": "7af37e22-6837-49b2-aecb-40646534c4b7"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:35:19.218410 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:35:19.221229 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-8fe17b6b-99a2-410a-a9c0-c30a905492d8 req-3d218d15-d6e2-40c5-aad2-9b6631c76cb9 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:19.221882 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-8fe17b6b-99a2-410a-a9c0-c30a905492d8 req-3d218d15-d6e2-40c5-aad2-9b6631c76cb9 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:19.222435 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-8fe17b6b-99a2-410a-a9c0-c30a905492d8 req-3d218d15-d6e2-40c5-aad2-9b6631c76cb9 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:19.238813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-8fe17b6b-99a2-410a-a9c0-c30a905492d8 req-3d218d15-d6e2-40c5-aad2-9b6631c76cb9 service nova] Creating event network-changed:7af37e22-6837-49b2-aecb-40646534c4b7 for instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da on hv-cinder-85394 Aug 22 17:35:19.247013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-8fe17b6b-99a2-410a-a9c0-c30a905492d8 req-3d218d15-d6e2-40c5-aad2-9b6631c76cb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046910 Aug 22 17:35:19.247783 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 394/789] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:35:19.682762 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5426f4e1-c04d-46f2-8e02-02aeee33a3e4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:19.683905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5426f4e1-c04d-46f2-8e02-02aeee33a3e4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:19.692617 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5426f4e1-c04d-46f2-8e02-02aeee33a3e4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:19.693418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5426f4e1-c04d-46f2-8e02-02aeee33a3e4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:19.694023 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5426f4e1-c04d-46f2-8e02-02aeee33a3e4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:19.695014 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5426f4e1-c04d-46f2-8e02-02aeee33a3e4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:19.695669 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5426f4e1-c04d-46f2-8e02-02aeee33a3e4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:19.696208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5426f4e1-c04d-46f2-8e02-02aeee33a3e4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:20.015180 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5426f4e1-c04d-46f2-8e02-02aeee33a3e4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:20.029256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5426f4e1-c04d-46f2-8e02-02aeee33a3e4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1265 microversion: 2.1 time: 0.351536 Aug 22 17:35:20.030315 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 396/790] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:19 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:35:21.057740 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4e0b38c3-91a4-43bc-ab52-b1d9ec582130 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:21.058910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4e0b38c3-91a4-43bc-ab52-b1d9ec582130 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:21.069643 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e0b38c3-91a4-43bc-ab52-b1d9ec582130 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:21.070592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e0b38c3-91a4-43bc-ab52-b1d9ec582130 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:21.071410 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e0b38c3-91a4-43bc-ab52-b1d9ec582130 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:21.072671 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e0b38c3-91a4-43bc-ab52-b1d9ec582130 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:21.073506 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e0b38c3-91a4-43bc-ab52-b1d9ec582130 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:21.074264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4e0b38c3-91a4-43bc-ab52-b1d9ec582130 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:21.288155 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4e0b38c3-91a4-43bc-ab52-b1d9ec582130 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:21.297369 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4e0b38c3-91a4-43bc-ab52-b1d9ec582130 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1265 microversion: 2.1 time: 0.248603 Aug 22 17:35:21.298117 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 395/791] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:21 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:22.321806 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6179f4c5-7a1a-4e62-89a5-61b6222965fd tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:22.322718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6179f4c5-7a1a-4e62-89a5-61b6222965fd tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:22.325366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:35:22.330520 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6179f4c5-7a1a-4e62-89a5-61b6222965fd tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:22.331059 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6179f4c5-7a1a-4e62-89a5-61b6222965fd tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:22.331607 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6179f4c5-7a1a-4e62-89a5-61b6222965fd tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:22.332425 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6179f4c5-7a1a-4e62-89a5-61b6222965fd tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:22.332980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6179f4c5-7a1a-4e62-89a5-61b6222965fd tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:22.333507 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6179f4c5-7a1a-4e62-89a5-61b6222965fd tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:22.529371 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6179f4c5-7a1a-4e62-89a5-61b6222965fd tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:22.534054 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=100 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:35:22.542050 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6179f4c5-7a1a-4e62-89a5-61b6222965fd tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1265 microversion: 2.1 time: 0.225473 Aug 22 17:35:22.546637 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 397/792] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:22 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1265 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:35:23.581079 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a041e93c-0a16-4f38-812f-6e94de5f5ed2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:23.582126 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a041e93c-0a16-4f38-812f-6e94de5f5ed2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:23.591904 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a041e93c-0a16-4f38-812f-6e94de5f5ed2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:23.592558 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a041e93c-0a16-4f38-812f-6e94de5f5ed2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:23.593103 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a041e93c-0a16-4f38-812f-6e94de5f5ed2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:23.594163 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a041e93c-0a16-4f38-812f-6e94de5f5ed2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:23.594766 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a041e93c-0a16-4f38-812f-6e94de5f5ed2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:23.595389 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a041e93c-0a16-4f38-812f-6e94de5f5ed2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:23.818686 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a041e93c-0a16-4f38-812f-6e94de5f5ed2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:23.820026 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a041e93c-0a16-4f38-812f-6e94de5f5ed2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1265 microversion: 2.1 time: 0.243356 Aug 22 17:35:23.820632 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 396/793] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:23 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:24.845773 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a8dc0395-4250-4e1a-be8d-616affa53019 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:24.847673 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a8dc0395-4250-4e1a-be8d-616affa53019 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:24.849191 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:35:24.850786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=6 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:35:24.856521 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8dc0395-4250-4e1a-be8d-616affa53019 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:24.857012 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8dc0395-4250-4e1a-be8d-616affa53019 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:24.857457 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8dc0395-4250-4e1a-be8d-616affa53019 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:24.858176 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8dc0395-4250-4e1a-be8d-616affa53019 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:24.858745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8dc0395-4250-4e1a-be8d-616affa53019 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:24.859178 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8dc0395-4250-4e1a-be8d-616affa53019 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:25.046009 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a8dc0395-4250-4e1a-be8d-616affa53019 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:25.059217 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a8dc0395-4250-4e1a-be8d-616affa53019 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1265 microversion: 2.1 time: 0.217114 Aug 22 17:35:25.060330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 398/794] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:24 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:26.095020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8806f6d8-afe5-4f08-8526-b1090e91d0c2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:26.095739 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8806f6d8-afe5-4f08-8526-b1090e91d0c2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:26.098302 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=4 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:35:26.104096 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8806f6d8-afe5-4f08-8526-b1090e91d0c2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:26.104703 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8806f6d8-afe5-4f08-8526-b1090e91d0c2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:26.105146 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8806f6d8-afe5-4f08-8526-b1090e91d0c2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:26.105865 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8806f6d8-afe5-4f08-8526-b1090e91d0c2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:26.106323 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8806f6d8-afe5-4f08-8526-b1090e91d0c2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:26.106780 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8806f6d8-afe5-4f08-8526-b1090e91d0c2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:26.413692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8806f6d8-afe5-4f08-8526-b1090e91d0c2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:26.422121 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8806f6d8-afe5-4f08-8526-b1090e91d0c2 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1265 microversion: 2.1 time: 0.331417 Aug 22 17:35:26.422753 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 397/795] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:26 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1265 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:35:27.443604 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-72acece5-591a-4142-998f-3990faaf36e8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:27.444538 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-72acece5-591a-4142-998f-3990faaf36e8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:27.451944 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72acece5-591a-4142-998f-3990faaf36e8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:27.452491 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72acece5-591a-4142-998f-3990faaf36e8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:27.452991 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72acece5-591a-4142-998f-3990faaf36e8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:27.454062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72acece5-591a-4142-998f-3990faaf36e8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:27.455059 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72acece5-591a-4142-998f-3990faaf36e8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:27.455771 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72acece5-591a-4142-998f-3990faaf36e8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:27.637033 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-72acece5-591a-4142-998f-3990faaf36e8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:27.645326 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-72acece5-591a-4142-998f-3990faaf36e8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1265 microversion: 2.1 time: 0.205831 Aug 22 17:35:27.645998 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 399/796] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:27 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:28.668430 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-fc7e47e8-b8f1-4fc6-9c68-f2964c632e66 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:28.669661 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-fc7e47e8-b8f1-4fc6-9c68-f2964c632e66 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:28.676651 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc7e47e8-b8f1-4fc6-9c68-f2964c632e66 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:28.677141 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc7e47e8-b8f1-4fc6-9c68-f2964c632e66 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:28.677580 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc7e47e8-b8f1-4fc6-9c68-f2964c632e66 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:28.678914 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc7e47e8-b8f1-4fc6-9c68-f2964c632e66 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:28.679568 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc7e47e8-b8f1-4fc6-9c68-f2964c632e66 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:28.680006 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc7e47e8-b8f1-4fc6-9c68-f2964c632e66 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:28.885733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-fc7e47e8-b8f1-4fc6-9c68-f2964c632e66 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:28.899421 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-fc7e47e8-b8f1-4fc6-9c68-f2964c632e66 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1265 microversion: 2.1 time: 0.234957 Aug 22 17:35:28.900419 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 398/797] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:28 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1265 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:29.927672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8a933664-6bcc-4a29-96a7-9d737a73928c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:29.928812 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8a933664-6bcc-4a29-96a7-9d737a73928c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:29.944171 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a933664-6bcc-4a29-96a7-9d737a73928c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:29.945299 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a933664-6bcc-4a29-96a7-9d737a73928c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:29.946087 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a933664-6bcc-4a29-96a7-9d737a73928c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:29.947470 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a933664-6bcc-4a29-96a7-9d737a73928c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:29.948312 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a933664-6bcc-4a29-96a7-9d737a73928c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:29.949072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8a933664-6bcc-4a29-96a7-9d737a73928c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:30.124027 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-a8076f92-05ff-430b-9b0a-ffe2e7abd6b2 req-26ec1e85-b03b-4fd8-8158-eeeb8bb69b6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da", "name": "network-vif-plugged", "status": "completed", "tag": "7af37e22-6837-49b2-aecb-40646534c4b7"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:35:30.140804 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-a8076f92-05ff-430b-9b0a-ffe2e7abd6b2 req-26ec1e85-b03b-4fd8-8158-eeeb8bb69b6e service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:30.141244 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-a8076f92-05ff-430b-9b0a-ffe2e7abd6b2 req-26ec1e85-b03b-4fd8-8158-eeeb8bb69b6e service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:30.141977 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-a8076f92-05ff-430b-9b0a-ffe2e7abd6b2 req-26ec1e85-b03b-4fd8-8158-eeeb8bb69b6e service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:30.147402 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8a933664-6bcc-4a29-96a7-9d737a73928c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:30.161161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8a933664-6bcc-4a29-96a7-9d737a73928c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1265 microversion: 2.1 time: 0.240785 Aug 22 17:35:30.163551 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 400/798] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:29 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1265 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:30.163838 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-a8076f92-05ff-430b-9b0a-ffe2e7abd6b2 req-26ec1e85-b03b-4fd8-8158-eeeb8bb69b6e service nova] Creating event network-vif-plugged:7af37e22-6837-49b2-aecb-40646534c4b7 for instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da on hv-cinder-85394 Aug 22 17:35:30.168926 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-a8076f92-05ff-430b-9b0a-ffe2e7abd6b2 req-26ec1e85-b03b-4fd8-8158-eeeb8bb69b6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049944 Aug 22 17:35:30.170271 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 399/799] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:35:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:35:31.188379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2d87de16-8c04-45db-b3d6-c735c213c79e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:31.189847 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-2d87de16-8c04-45db-b3d6-c735c213c79e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:31.199251 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2d87de16-8c04-45db-b3d6-c735c213c79e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:31.202742 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2d87de16-8c04-45db-b3d6-c735c213c79e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:31.202742 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2d87de16-8c04-45db-b3d6-c735c213c79e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:31.202742 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2d87de16-8c04-45db-b3d6-c735c213c79e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:31.202742 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2d87de16-8c04-45db-b3d6-c735c213c79e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:31.203372 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2d87de16-8c04-45db-b3d6-c735c213c79e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:31.435898 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2d87de16-8c04-45db-b3d6-c735c213c79e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:31.446442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2d87de16-8c04-45db-b3d6-c735c213c79e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1265 microversion: 2.1 time: 0.264369 Aug 22 17:35:31.447349 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 401/800] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:31 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:32.472909 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4656c172-6544-43d4-a04a-a690e8596baf tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:32.473827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4656c172-6544-43d4-a04a-a690e8596baf tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:32.481478 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4656c172-6544-43d4-a04a-a690e8596baf tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:32.481999 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4656c172-6544-43d4-a04a-a690e8596baf tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:32.482425 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4656c172-6544-43d4-a04a-a690e8596baf tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:32.483165 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4656c172-6544-43d4-a04a-a690e8596baf tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:32.483613 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4656c172-6544-43d4-a04a-a690e8596baf tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:32.484032 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4656c172-6544-43d4-a04a-a690e8596baf tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:32.667323 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4656c172-6544-43d4-a04a-a690e8596baf tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:32.676051 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4656c172-6544-43d4-a04a-a690e8596baf tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1265 microversion: 2.1 time: 0.209260 Aug 22 17:35:32.676640 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 400/801] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:32 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:33.697865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4716eba2-8a77-4519-b129-b27726a3740a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:33.699149 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4716eba2-8a77-4519-b129-b27726a3740a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:33.707851 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4716eba2-8a77-4519-b129-b27726a3740a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:33.710565 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4716eba2-8a77-4519-b129-b27726a3740a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:33.710565 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4716eba2-8a77-4519-b129-b27726a3740a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:33.710565 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4716eba2-8a77-4519-b129-b27726a3740a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:33.711281 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4716eba2-8a77-4519-b129-b27726a3740a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:33.711816 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4716eba2-8a77-4519-b129-b27726a3740a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:33.943904 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4716eba2-8a77-4519-b129-b27726a3740a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:33.954370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4716eba2-8a77-4519-b129-b27726a3740a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1452 microversion: 2.1 time: 0.260479 Aug 22 17:35:33.955436 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 402/802] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:33 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1452 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:33.976193 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-7e28330b-bd69-40ca-85e3-8fa90d58980a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:35:33.976850 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-7e28330b-bd69-40ca-85e3-8fa90d58980a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:35:33.984251 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e28330b-bd69-40ca-85e3-8fa90d58980a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:33.985007 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e28330b-bd69-40ca-85e3-8fa90d58980a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:33.985709 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e28330b-bd69-40ca-85e3-8fa90d58980a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:33.986890 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e28330b-bd69-40ca-85e3-8fa90d58980a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:33.987581 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e28330b-bd69-40ca-85e3-8fa90d58980a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:33.988302 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e28330b-bd69-40ca-85e3-8fa90d58980a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:34.158434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7e28330b-bd69-40ca-85e3-8fa90d58980a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:35:34.167065 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-7e28330b-bd69-40ca-85e3-8fa90d58980a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1452 microversion: 2.1 time: 0.194593 Aug 22 17:35:34.167661 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 401/803] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:35:33 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1452 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:35:36.993253 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-c7fc3182-dc21-4424-9c12-469247585572 req-9f632278-7216-442b-8545-fabfcb02f323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da", "tag": "7af37e22-6837-49b2-aecb-40646534c4b7"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:35:37.013935 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-c7fc3182-dc21-4424-9c12-469247585572 req-9f632278-7216-442b-8545-fabfcb02f323 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:35:37.014808 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-c7fc3182-dc21-4424-9c12-469247585572 req-9f632278-7216-442b-8545-fabfcb02f323 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:35:37.015545 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-c7fc3182-dc21-4424-9c12-469247585572 req-9f632278-7216-442b-8545-fabfcb02f323 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:35:37.031370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-c7fc3182-dc21-4424-9c12-469247585572 req-9f632278-7216-442b-8545-fabfcb02f323 service nova] Creating event network-changed:7af37e22-6837-49b2-aecb-40646534c4b7 for instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da on hv-cinder-85394 Aug 22 17:35:37.039430 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-c7fc3182-dc21-4424-9c12-469247585572 req-9f632278-7216-442b-8545-fabfcb02f323 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053099 Aug 22 17:35:37.040908 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 403/804] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:36:12.295723 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-81c30f17-329a-42a9-b210-c942315d522d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:12.296613 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-81c30f17-329a-42a9-b210-c942315d522d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:12.300999 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=15 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:36:12.302814 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=79 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:36:12.311639 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-81c30f17-329a-42a9-b210-c942315d522d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:12.312569 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-81c30f17-329a-42a9-b210-c942315d522d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:12.313318 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-81c30f17-329a-42a9-b210-c942315d522d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:12.314610 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-81c30f17-329a-42a9-b210-c942315d522d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:12.315505 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-81c30f17-329a-42a9-b210-c942315d522d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:12.316249 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-81c30f17-329a-42a9-b210-c942315d522d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:12.363130 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-81c30f17-329a-42a9-b210-c942315d522d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/ips" status: 200 len: 148 microversion: 2.1 time: 0.074946 Aug 22 17:36:12.365309 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 402/805] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 22 17:36:12 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/ips => generated 148 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:36:15.495801 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-436e80e6-477d-4dfd-9d2e-31b4e08cf13b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87e7878c-2191-4186-9577-092748412b24"}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:36:15.504991 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-436e80e6-477d-4dfd-9d2e-31b4e08cf13b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:15.514376 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=13 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:36:15.515937 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=32 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:36:15.519587 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-436e80e6-477d-4dfd-9d2e-31b4e08cf13b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:15.521209 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-436e80e6-477d-4dfd-9d2e-31b4e08cf13b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:15.521890 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-436e80e6-477d-4dfd-9d2e-31b4e08cf13b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:15.523487 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-436e80e6-477d-4dfd-9d2e-31b4e08cf13b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:15.524584 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-436e80e6-477d-4dfd-9d2e-31b4e08cf13b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:15.525338 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-436e80e6-477d-4dfd-9d2e-31b4e08cf13b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:16.694641 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-436e80e6-477d-4dfd-9d2e-31b4e08cf13b tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "POST /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.209533 Aug 22 17:36:16.702444 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 404/806] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 22 17:36:15 2022] POST /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-volume_attachments => generated 194 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:36:25.776385 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-288dca19-8683-4ca0-bca8-bd495c181ab2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87e7878c-2191-4186-9577-092748412b24"}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:36:25.780762 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-288dca19-8683-4ca0-bca8-bd495c181ab2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:25.792339 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-288dca19-8683-4ca0-bca8-bd495c181ab2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:25.793634 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-288dca19-8683-4ca0-bca8-bd495c181ab2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:25.794381 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-288dca19-8683-4ca0-bca8-bd495c181ab2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:25.796113 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-288dca19-8683-4ca0-bca8-bd495c181ab2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:25.797259 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-288dca19-8683-4ca0-bca8-bd495c181ab2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:25.797940 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-288dca19-8683-4ca0-bca8-bd495c181ab2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:25.932979 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-288dca19-8683-4ca0-bca8-bd495c181ab2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] HTTP exception thrown: Invalid volume: volume 87e7878c-2191-4186-9577-092748412b24 is already attached to instances: da06f40f-ae38-492b-8867-2ffe54655d17 Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-288dca19-8683-4ca0-bca8-bd495c181ab2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Request method failure captured: Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: POST /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-volume_attachments HTTP/1.1 Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 74 Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA7xLFyP3sazpo8lNxFPukerJWviDoPTaEBmzGGnNT2hK_WSNwW1QEyJSvA7cujhX4n3KzSw_ywGF8KgQMwv_P1bklerqKHJCnSQNmsRxQWmDXBuOt_ZETYxuWcB2qstyCMegdrnu-rvFjhw-dLXTo-dX3Y3VP9AGooFNTG8HqCGsto4 Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:36:25.934859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:36:25.936228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6436020e938047408d1f979e23dd48da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6436020e938047408d1f979e23dd48da", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:36:25.936228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:36:25.936228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:36:25.936228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:36:25.936228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:36:25.936228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:36:25.936228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:36:25.936228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: b0db362075b04b2294a6268576a5bba3 Aug 22 17:36:25.936228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:36:25.936228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Aug 22 17:36:25.936228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {"volumeAttachment": {"volumeId": "87e7878c-2191-4186-9577-092748412b24"}} Aug 22 17:36:25.936228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Invalid volume: volume 87e7878c-2191-4186-9577-092748412b24 is already attached to instances: da06f40f-ae38-492b-8867-2ffe54655d17 Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'server_id': 'da06f40f-ae38-492b-8867-2ffe54655d17', 'body': {'volumeAttachment': {'volumeId': '87e7878c-2191-4186-9577-092748412b24'}}} Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 87e7878c-2191-4186-9577-092748412b24 is already attached to instances: da06f40f-ae38-492b-8867-2ffe54655d17 Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:36:25.937075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 87e7878c-2191-4186-9577-092748412b24 is already attached to instances: da06f40f-ae38-492b-8867-2ffe54655d17 Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:36:25.942013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:36:25.944093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:36:25.944093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:36:25.944093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:36:25.944093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 87e7878c-2191-4186-9577-092748412b24 is already attached to instances: da06f40f-ae38-492b-8867-2ffe54655d17 Aug 22 17:36:25.944093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:36:25.944093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-288dca19-8683-4ca0-bca8-bd495c181ab2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Returning 400 to user: Invalid volume: volume 87e7878c-2191-4186-9577-092748412b24 is already attached to instances: da06f40f-ae38-492b-8867-2ffe54655d17 {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:36:25.944093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-288dca19-8683-4ca0-bca8-bd495c181ab2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "POST /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.170274 Aug 22 17:36:25.944093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 403/807] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 22 17:36:25 2022] POST /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-volume_attachments => generated 174 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:36:26.072465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5544f800-f6b3-4c45-84a9-868650b16112 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:26.072720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-af7ceb1c-429d-4d17-be11-ca4def253b0c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2018233057"}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:36:26.073181 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5544f800-f6b3-4c45-84a9-868650b16112 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:26.075811 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-af7ceb1c-429d-4d17-be11-ca4def253b0c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:26.081070 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5544f800-f6b3-4c45-84a9-868650b16112 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:26.081576 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5544f800-f6b3-4c45-84a9-868650b16112 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:26.082581 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5544f800-f6b3-4c45-84a9-868650b16112 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:26.083881 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5544f800-f6b3-4c45-84a9-868650b16112 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:26.084833 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:36:26.085053 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5544f800-f6b3-4c45-84a9-868650b16112 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:26.085688 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5544f800-f6b3-4c45-84a9-868650b16112 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:26.087422 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af7ceb1c-429d-4d17-be11-ca4def253b0c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:26.093038 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af7ceb1c-429d-4d17-be11-ca4def253b0c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:26.093038 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af7ceb1c-429d-4d17-be11-ca4def253b0c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:26.093038 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af7ceb1c-429d-4d17-be11-ca4def253b0c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:26.093038 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af7ceb1c-429d-4d17-be11-ca4def253b0c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:26.093485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-af7ceb1c-429d-4d17-be11-ca4def253b0c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:26.240915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-5544f800-f6b3-4c45-84a9-868650b16112 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lazy-loading 'services' on Instance uuid da06f40f-ae38-492b-8867-2ffe54655d17 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:36:26.274293 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.network.security_group_api [None req-af7ceb1c-429d-4d17-be11-ca4def253b0c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Removing security group e256c206-fd20-460d-bc15-ff85bd2bab95 from port a4e21f10-9c29-4641-93d3-684817ef690e Aug 22 17:36:26.512770 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5544f800-f6b3-4c45-84a9-868650b16112 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-volume_attachments/87e7878c-2191-4186-9577-092748412b24" status: 202 len: 0 microversion: 2.1 time: 0.444351 Aug 22 17:36:26.513366 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 404/808] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 22 17:36:26 2022] DELETE /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-volume_attachments/87e7878c-2191-4186-9577-092748412b24 => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:36:26.532350 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8672aa3e-9f21-4286-b3ba-f43d0176ed8e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:26.537872 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8672aa3e-9f21-4286-b3ba-f43d0176ed8e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:26.552375 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8672aa3e-9f21-4286-b3ba-f43d0176ed8e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:26.553695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8672aa3e-9f21-4286-b3ba-f43d0176ed8e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:26.555688 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8672aa3e-9f21-4286-b3ba-f43d0176ed8e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:26.564203 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8672aa3e-9f21-4286-b3ba-f43d0176ed8e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:26.564203 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8672aa3e-9f21-4286-b3ba-f43d0176ed8e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:26.564203 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8672aa3e-9f21-4286-b3ba-f43d0176ed8e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:26.686929 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8672aa3e-9f21-4286-b3ba-f43d0176ed8e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.164745 Aug 22 17:36:26.696451 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 405/809] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:36:26 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-volume_attachments => generated 197 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:36:26.939831 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-af7ceb1c-429d-4d17-be11-ca4def253b0c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "POST /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/action" status: 202 len: 0 microversion: 2.1 time: 0.890418 Aug 22 17:36:26.940816 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 405/810] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 22 17:36:26 2022] POST /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/action => generated 0 bytes in 893 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:36:26.955781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-92a4f8a6-a5ed-4d22-8ba1-e14a92d97d02 req-05efff14-c1de-420b-9228-abac52915c6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ff94bc-e986-4201-96e7-484c08490011", "tag": "a4e21f10-9c29-4641-93d3-684817ef690e"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:36:26.990035 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-92a4f8a6-a5ed-4d22-8ba1-e14a92d97d02 req-05efff14-c1de-420b-9228-abac52915c6d service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:26.990871 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-92a4f8a6-a5ed-4d22-8ba1-e14a92d97d02 req-05efff14-c1de-420b-9228-abac52915c6d service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:26.991795 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-92a4f8a6-a5ed-4d22-8ba1-e14a92d97d02 req-05efff14-c1de-420b-9228-abac52915c6d service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:27.022277 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-92a4f8a6-a5ed-4d22-8ba1-e14a92d97d02 req-05efff14-c1de-420b-9228-abac52915c6d service nova] Creating event network-changed:a4e21f10-9c29-4641-93d3-684817ef690e for instance 84ff94bc-e986-4201-96e7-484c08490011 on hv-cinder-85394 Aug 22 17:36:27.036367 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-92a4f8a6-a5ed-4d22-8ba1-e14a92d97d02 req-05efff14-c1de-420b-9228-abac52915c6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089543 Aug 22 17:36:27.041339 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 406/811] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:36:27.728121 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-75206266-b8cf-4789-a9b3-b4b1012878d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:27.734950 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-75206266-b8cf-4789-a9b3-b4b1012878d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:27.764606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-75206266-b8cf-4789-a9b3-b4b1012878d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:27.766419 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-75206266-b8cf-4789-a9b3-b4b1012878d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:27.767324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-75206266-b8cf-4789-a9b3-b4b1012878d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:27.768486 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-75206266-b8cf-4789-a9b3-b4b1012878d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:27.770720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-75206266-b8cf-4789-a9b3-b4b1012878d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:27.771854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-75206266-b8cf-4789-a9b3-b4b1012878d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:27.824441 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-75206266-b8cf-4789-a9b3-b4b1012878d5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122938 Aug 22 17:36:27.825939 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 406/812] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:36:27 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:36:28.845340 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0aa7c833-581b-45db-8bba-6231c2e1bc13 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:28.848394 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0aa7c833-581b-45db-8bba-6231c2e1bc13 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:28.856527 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0aa7c833-581b-45db-8bba-6231c2e1bc13 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:28.857032 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0aa7c833-581b-45db-8bba-6231c2e1bc13 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:28.857486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0aa7c833-581b-45db-8bba-6231c2e1bc13 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:28.858284 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0aa7c833-581b-45db-8bba-6231c2e1bc13 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:28.858810 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0aa7c833-581b-45db-8bba-6231c2e1bc13 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:28.859246 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0aa7c833-581b-45db-8bba-6231c2e1bc13 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:28.892873 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0aa7c833-581b-45db-8bba-6231c2e1bc13 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054585 Aug 22 17:36:28.893455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 407/813] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:36:28 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:36:28.982219 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d78a7ddf-fe11-4c57-9f47-cc8caa2b9e76 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:28.983097 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d78a7ddf-fe11-4c57-9f47-cc8caa2b9e76 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:28.991733 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d78a7ddf-fe11-4c57-9f47-cc8caa2b9e76 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:28.992305 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d78a7ddf-fe11-4c57-9f47-cc8caa2b9e76 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:28.992647 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d78a7ddf-fe11-4c57-9f47-cc8caa2b9e76 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:28.993371 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d78a7ddf-fe11-4c57-9f47-cc8caa2b9e76 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:28.993835 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d78a7ddf-fe11-4c57-9f47-cc8caa2b9e76 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:28.994262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d78a7ddf-fe11-4c57-9f47-cc8caa2b9e76 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:29.028009 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d78a7ddf-fe11-4c57-9f47-cc8caa2b9e76 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Going to try to terminate instance {{(pid=121852) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:36:29.385869 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d78a7ddf-fe11-4c57-9f47-cc8caa2b9e76 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 204 len: 0 microversion: 2.1 time: 0.407458 Aug 22 17:36:29.386951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 407/814] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:36:28 2022] DELETE /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 17:36:29.422065 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d8721d3d-724b-4553-a2a7-d6f9a01387b2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:29.433846 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d8721d3d-724b-4553-a2a7-d6f9a01387b2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:29.448838 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d8721d3d-724b-4553-a2a7-d6f9a01387b2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:29.449499 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d8721d3d-724b-4553-a2a7-d6f9a01387b2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:29.450049 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d8721d3d-724b-4553-a2a7-d6f9a01387b2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:29.451568 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d8721d3d-724b-4553-a2a7-d6f9a01387b2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:29.452173 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d8721d3d-724b-4553-a2a7-d6f9a01387b2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:29.452717 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d8721d3d-724b-4553-a2a7-d6f9a01387b2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:29.458755 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-bb1524bd-3274-4d64-802c-7118c64094a9 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Action: 'create', calling method: .version_select at 0x7f0e5c466040>, body: {"keypair": {"name": "tempest-TestShelveInstance-1343415650", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdgVhCQDgqXytadnO0YflxVRM+kFtSEzpEBZamUuVrDbXtC6obfUcP3Qkm9NL21IALYtXGmoyArnIgRpdbuHi4e9mAD/h9wmMSOEWtGqAoykGuDuLlm4+LsGtvTpOktkw=="}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:36:29.476969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-bb1524bd-3274-4d64-802c-7118c64094a9 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Getting quotas for project 608e3c25b97f4a75b2a80903a9d5c656. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:36:29.490447 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-bb1524bd-3274-4d64-802c-7118c64094a9 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Getting quotas for user 9454a7a736164ff09382babab30694d8 and project 608e3c25b97f4a75b2a80903a9d5c656. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:36:29.599192 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-bb1524bd-3274-4d64-802c-7118c64094a9 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.439363 Aug 22 17:36:29.600318 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 408/815] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 22 17:36:29 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:36:29.705323 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-d8721d3d-724b-4553-a2a7-d6f9a01387b2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:29.723749 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d8721d3d-724b-4553-a2a7-d6f9a01387b2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1680 microversion: 2.1 time: 0.328941 Aug 22 17:36:29.724945 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 408/816] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:29 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1680 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:36:30.243560 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-38b355b5-f8e1-4b6d-9a8a-edad034f9900 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:30.247117 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-38b355b5-f8e1-4b6d-9a8a-edad034f9900 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:30.263167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-38b355b5-f8e1-4b6d-9a8a-edad034f9900 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:30.263990 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-38b355b5-f8e1-4b6d-9a8a-edad034f9900 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:30.264623 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-38b355b5-f8e1-4b6d-9a8a-edad034f9900 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:30.265916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-38b355b5-f8e1-4b6d-9a8a-edad034f9900 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:30.267771 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-38b355b5-f8e1-4b6d-9a8a-edad034f9900 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:30.268395 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-38b355b5-f8e1-4b6d-9a8a-edad034f9900 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:30.280392 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-d2f29356-6bb7-4527-a243-e1dd365be8fb req-1212b3f0-c79b-4d65-a0a0-2414fe2b0af9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84ff94bc-e986-4201-96e7-484c08490011", "tag": "a4e21f10-9c29-4641-93d3-684817ef690e"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:36:30.338883 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-d2f29356-6bb7-4527-a243-e1dd365be8fb req-1212b3f0-c79b-4d65-a0a0-2414fe2b0af9 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:30.339405 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-d2f29356-6bb7-4527-a243-e1dd365be8fb req-1212b3f0-c79b-4d65-a0a0-2414fe2b0af9 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:30.341669 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-d2f29356-6bb7-4527-a243-e1dd365be8fb req-1212b3f0-c79b-4d65-a0a0-2414fe2b0af9 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:30.373235 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-d2f29356-6bb7-4527-a243-e1dd365be8fb req-1212b3f0-c79b-4d65-a0a0-2414fe2b0af9 service nova] Creating event network-changed:a4e21f10-9c29-4641-93d3-684817ef690e for instance 84ff94bc-e986-4201-96e7-484c08490011 on hv-cinder-85394 Aug 22 17:36:30.383498 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-d2f29356-6bb7-4527-a243-e1dd365be8fb req-1212b3f0-c79b-4d65-a0a0-2414fe2b0af9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127696 Aug 22 17:36:30.385062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 409/817] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:36:30.636813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-38b355b5-f8e1-4b6d-9a8a-edad034f9900 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lazy-loading 'services' on Instance uuid 84ff94bc-e986-4201-96e7-484c08490011 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:36:30.768146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-bb1457c2-5cf1-452f-81e8-52f2951ba289 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:30.768902 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-bb1457c2-5cf1-452f-81e8-52f2951ba289 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:30.777021 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bb1457c2-5cf1-452f-81e8-52f2951ba289 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:30.778796 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bb1457c2-5cf1-452f-81e8-52f2951ba289 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:30.779397 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bb1457c2-5cf1-452f-81e8-52f2951ba289 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:30.780481 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bb1457c2-5cf1-452f-81e8-52f2951ba289 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:30.781109 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bb1457c2-5cf1-452f-81e8-52f2951ba289 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:30.781739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bb1457c2-5cf1-452f-81e8-52f2951ba289 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:30.919973 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-38b355b5-f8e1-4b6d-9a8a-edad034f9900 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "DELETE /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/os-volume_attachments/0ad88b0b-3803-466d-9bb0-c1a0ad6b0c0f" status: 202 len: 0 microversion: 2.1 time: 0.687334 Aug 22 17:36:30.929138 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 409/818] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 22 17:36:30 2022] DELETE /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/os-volume_attachments/0ad88b0b-3803-466d-9bb0-c1a0ad6b0c0f => generated 0 bytes in 698 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:36:30.957951 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8e3dabf0-5dcf-4936-877d-3961ffb0b8a7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:30.966846 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8e3dabf0-5dcf-4936-877d-3961ffb0b8a7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:30.995578 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8e3dabf0-5dcf-4936-877d-3961ffb0b8a7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:30.996978 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8e3dabf0-5dcf-4936-877d-3961ffb0b8a7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:30.998242 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8e3dabf0-5dcf-4936-877d-3961ffb0b8a7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:30.999881 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8e3dabf0-5dcf-4936-877d-3961ffb0b8a7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:31.001607 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8e3dabf0-5dcf-4936-877d-3961ffb0b8a7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:31.003413 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8e3dabf0-5dcf-4936-877d-3961ffb0b8a7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:31.099718 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8e3dabf0-5dcf-4936-877d-3961ffb0b8a7 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.167385 Aug 22 17:36:31.103707 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 410/819] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:36:30 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/os-volume_attachments => generated 197 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:36:31.119818 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-bb1457c2-5cf1-452f-81e8-52f2951ba289 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:31.139833 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-bb1457c2-5cf1-452f-81e8-52f2951ba289 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1680 microversion: 2.1 time: 0.376119 Aug 22 17:36:31.140783 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 410/820] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:30 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1680 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:36:32.120936 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8d7d8ff3-3be4-4373-9b8f-63ec2494e073 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:32.123827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8d7d8ff3-3be4-4373-9b8f-63ec2494e073 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:32.143769 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8d7d8ff3-3be4-4373-9b8f-63ec2494e073 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:32.147354 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8d7d8ff3-3be4-4373-9b8f-63ec2494e073 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:32.147938 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8d7d8ff3-3be4-4373-9b8f-63ec2494e073 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:32.149759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8d7d8ff3-3be4-4373-9b8f-63ec2494e073 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:32.152420 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8d7d8ff3-3be4-4373-9b8f-63ec2494e073 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:32.154558 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8d7d8ff3-3be4-4373-9b8f-63ec2494e073 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:32.172590 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-24dac9c9-10a4-4707-a25d-341f1ca008e8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:32.173952 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-24dac9c9-10a4-4707-a25d-341f1ca008e8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:32.200584 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-24dac9c9-10a4-4707-a25d-341f1ca008e8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:32.203919 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-24dac9c9-10a4-4707-a25d-341f1ca008e8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:32.204459 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-24dac9c9-10a4-4707-a25d-341f1ca008e8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:32.208587 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-24dac9c9-10a4-4707-a25d-341f1ca008e8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:32.209142 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-24dac9c9-10a4-4707-a25d-341f1ca008e8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:32.209531 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-24dac9c9-10a4-4707-a25d-341f1ca008e8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:32.297981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8d7d8ff3-3be4-4373-9b8f-63ec2494e073 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.182453 Aug 22 17:36:32.308067 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 411/821] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:36:32 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:36:32.555062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-24dac9c9-10a4-4707-a25d-341f1ca008e8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:32.570727 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-24dac9c9-10a4-4707-a25d-341f1ca008e8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1680 microversion: 2.1 time: 0.402261 Aug 22 17:36:32.571691 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 411/822] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:32 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1680 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:36:33.318206 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-04f318f9-98be-475a-99f0-476f63520ca3 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:33.322307 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-04f318f9-98be-475a-99f0-476f63520ca3 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:33.370241 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-04f318f9-98be-475a-99f0-476f63520ca3 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:33.372607 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-04f318f9-98be-475a-99f0-476f63520ca3 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:33.374006 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-04f318f9-98be-475a-99f0-476f63520ca3 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:33.379413 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-04f318f9-98be-475a-99f0-476f63520ca3 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:33.381479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-04f318f9-98be-475a-99f0-476f63520ca3 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:33.383916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-04f318f9-98be-475a-99f0-476f63520ca3 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:33.497610 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-04f318f9-98be-475a-99f0-476f63520ca3 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.183327 Aug 22 17:36:33.509236 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 412/823] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:36:33 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/os-volume_attachments => generated 25 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 22 17:36:33.548474 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-db338bb3-36b2-4a34-99e6-936cd6445f1a req-4f919c45-73f6-42ed-b15a-068db17470a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da06f40f-ae38-492b-8867-2ffe54655d17", "name": "network-vif-deleted", "tag": "074dcdd1-c55a-4f30-b411-c39e5026a6c5"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:36:33.549256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-7d4491fa-75fb-48c1-88a7-09b049a3ae16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:33.551443 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-7d4491fa-75fb-48c1-88a7-09b049a3ae16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:33.579700 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7d4491fa-75fb-48c1-88a7-09b049a3ae16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:33.580863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7d4491fa-75fb-48c1-88a7-09b049a3ae16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:33.590795 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7d4491fa-75fb-48c1-88a7-09b049a3ae16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:33.592870 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7d4491fa-75fb-48c1-88a7-09b049a3ae16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:33.594637 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-db338bb3-36b2-4a34-99e6-936cd6445f1a req-4f919c45-73f6-42ed-b15a-068db17470a0 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:33.595262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7d4491fa-75fb-48c1-88a7-09b049a3ae16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:33.596071 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7d4491fa-75fb-48c1-88a7-09b049a3ae16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:33.599825 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-db338bb3-36b2-4a34-99e6-936cd6445f1a req-4f919c45-73f6-42ed-b15a-068db17470a0 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:33.602752 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-db338bb3-36b2-4a34-99e6-936cd6445f1a req-4f919c45-73f6-42ed-b15a-068db17470a0 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:33.674536 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-db338bb3-36b2-4a34-99e6-936cd6445f1a req-4f919c45-73f6-42ed-b15a-068db17470a0 service nova] Creating event network-vif-deleted:074dcdd1-c55a-4f30-b411-c39e5026a6c5 for instance da06f40f-ae38-492b-8867-2ffe54655d17 on hv-cinder-85394 Aug 22 17:36:33.689246 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-db338bb3-36b2-4a34-99e6-936cd6445f1a req-4f919c45-73f6-42ed-b15a-068db17470a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155511 Aug 22 17:36:33.693441 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 413/824] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:36:33.720539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f880fe4f-a28d-4b86-9381-eb3a8228c9e4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:33.721790 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f880fe4f-a28d-4b86-9381-eb3a8228c9e4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:33.761027 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f880fe4f-a28d-4b86-9381-eb3a8228c9e4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:33.761920 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f880fe4f-a28d-4b86-9381-eb3a8228c9e4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:33.762687 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f880fe4f-a28d-4b86-9381-eb3a8228c9e4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:33.763939 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f880fe4f-a28d-4b86-9381-eb3a8228c9e4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:33.764919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f880fe4f-a28d-4b86-9381-eb3a8228c9e4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:33.775365 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f880fe4f-a28d-4b86-9381-eb3a8228c9e4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:33.882766 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f880fe4f-a28d-4b86-9381-eb3a8228c9e4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:33.903109 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f880fe4f-a28d-4b86-9381-eb3a8228c9e4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1326 microversion: 2.1 time: 0.206771 Aug 22 17:36:33.904790 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 414/825] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:33 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1326 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:33.952426 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-7d4491fa-75fb-48c1-88a7-09b049a3ae16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] HTTP exception thrown: Instance 84ff94bc-e986-4201-96e7-484c08490011 is not attached to volume 0ad88b0b-3803-466d-9bb0-c1a0ad6b0c0f Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-7d4491fa-75fb-48c1-88a7-09b049a3ae16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Request method failure captured: Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: DELETE /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/os-volume_attachments/0ad88b0b-3803-466d-9bb0-c1a0ad6b0c0f HTTP/1.1 Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA72P1-I5CB4aNWzdttkwObwrRg8hg3DjQEXYTcEuh9nQSpAXLZm8FphbKndW9CHExIDxc9VdXZEPUXkkAw3AVf1H6fCXEtf45Q3xUX2wKLdNbV89YHtmPUQbnK7j0k5PQOyoBo-_-g3tBnBmlBZip7K3UJ8J3HHAdKouUl3yENvTmsM Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 11871f979145455499b30912da1abcfd Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-TestMinimumBasicScenario-1698294823 Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:36:33.963519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:36:33.964980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/11871f979145455499b30912da1abcfd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/11871f979145455499b30912da1abcfd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/11871f979145455499b30912da1abcfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_11871f979145455499b30912da1abcfd", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:36:33.964980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-TestMinimumBasicScenario-1698294823 Aug 22 17:36:33.964980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 11871f979145455499b30912da1abcfd Aug 22 17:36:33.964980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1698294823 Aug 22 17:36:33.964980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-TestMinimumBasicScenario-1698294823-project Aug 22 17:36:33.964980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:36:33.964980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:36:33.964980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: aff4cd6b5ec14cb29813416b1d929333 Aug 22 17:36:33.964980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-TestMinimumBasicScenario-1698294823-project Aug 22 17:36:33.964980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:36:33.964980 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance 84ff94bc-e986-4201-96e7-484c08490011 is not attached to volume 0ad88b0b-3803-466d-9bb0-c1a0ad6b0c0f Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'server_id': '84ff94bc-e986-4201-96e7-484c08490011', 'id': '0ad88b0b-3803-466d-9bb0-c1a0ad6b0c0f'} Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0ad88b0b-3803-466d-9bb0-c1a0ad6b0c0f. Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:36:33.965714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ff94bc-e986-4201-96e7-484c08490011 is not attached to volume 0ad88b0b-3803-466d-9bb0-c1a0ad6b0c0f Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ff94bc-e986-4201-96e7-484c08490011 is not attached to volume 0ad88b0b-3803-466d-9bb0-c1a0ad6b0c0f Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:36:33.967062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-7d4491fa-75fb-48c1-88a7-09b049a3ae16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Returning 404 to user: Instance 84ff94bc-e986-4201-96e7-484c08490011 is not attached to volume 0ad88b0b-3803-466d-9bb0-c1a0ad6b0c0f {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:36:33.968001 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-7d4491fa-75fb-48c1-88a7-09b049a3ae16 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "DELETE /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/os-volume_attachments/0ad88b0b-3803-466d-9bb0-c1a0ad6b0c0f" status: 404 len: 154 microversion: 2.1 time: 0.454458 Aug 22 17:36:33.968001 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 412/826] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 22 17:36:33 2022] DELETE /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011/os-volume_attachments/0ad88b0b-3803-466d-9bb0-c1a0ad6b0c0f => generated 154 bytes in 457 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:36:34.932068 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ea807b30-4962-4ab3-9028-c6620a757d8c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:34.934432 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ea807b30-4962-4ab3-9028-c6620a757d8c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:34.946196 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea807b30-4962-4ab3-9028-c6620a757d8c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:34.947367 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea807b30-4962-4ab3-9028-c6620a757d8c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:34.948141 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea807b30-4962-4ab3-9028-c6620a757d8c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:34.949557 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea807b30-4962-4ab3-9028-c6620a757d8c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:34.950812 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea807b30-4962-4ab3-9028-c6620a757d8c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:34.955196 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea807b30-4962-4ab3-9028-c6620a757d8c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:35.008893 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea807b30-4962-4ab3-9028-c6620a757d8c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:35.010010 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea807b30-4962-4ab3-9028-c6620a757d8c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:35.010895 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea807b30-4962-4ab3-9028-c6620a757d8c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:35.011929 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-ea807b30-4962-4ab3-9028-c6620a757d8c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lazy-loading 'fault' on Instance uuid da06f40f-ae38-492b-8867-2ffe54655d17 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:36:35.065584 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ea807b30-4962-4ab3-9028-c6620a757d8c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:35.083677 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ea807b30-4962-4ab3-9028-c6620a757d8c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 200 len: 1331 microversion: 2.1 time: 0.161290 Aug 22 17:36:35.084885 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 415/827] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:34 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 1331 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:36:35.379682 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4e21d6c9-07fb-4939-bd55-12679221f682 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:35.380567 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4e21d6c9-07fb-4939-bd55-12679221f682 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:35.388049 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e21d6c9-07fb-4939-bd55-12679221f682 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:35.388662 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e21d6c9-07fb-4939-bd55-12679221f682 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:35.389369 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e21d6c9-07fb-4939-bd55-12679221f682 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:35.390143 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e21d6c9-07fb-4939-bd55-12679221f682 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:35.390676 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e21d6c9-07fb-4939-bd55-12679221f682 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:35.391182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4e21d6c9-07fb-4939-bd55-12679221f682 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:35.431779 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4e21d6c9-07fb-4939-bd55-12679221f682 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Going to try to terminate instance {{(pid=121852) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:36:35.859229 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4e21d6c9-07fb-4939-bd55-12679221f682 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "DELETE /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 204 len: 0 microversion: 2.1 time: 0.484553 Aug 22 17:36:35.860119 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 413/828] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:36:35 2022] DELETE /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:36:35.874103 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-691c5464-c284-49d5-bfd9-883ceba5ff1b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:35.875638 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-691c5464-c284-49d5-bfd9-883ceba5ff1b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:35.914519 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-691c5464-c284-49d5-bfd9-883ceba5ff1b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:35.915864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-691c5464-c284-49d5-bfd9-883ceba5ff1b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:35.916956 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-691c5464-c284-49d5-bfd9-883ceba5ff1b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:35.918593 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-691c5464-c284-49d5-bfd9-883ceba5ff1b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:35.919720 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-691c5464-c284-49d5-bfd9-883ceba5ff1b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:35.920809 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-691c5464-c284-49d5-bfd9-883ceba5ff1b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:36.127295 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-691c5464-c284-49d5-bfd9-883ceba5ff1b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:36.145427 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-691c5464-c284-49d5-bfd9-883ceba5ff1b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1554 microversion: 2.1 time: 0.276988 Aug 22 17:36:36.147369 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 416/829] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:35 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1554 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:36.426911 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-df3bf67e-4c1a-4ea5-b8f2-fae6b9b59b1c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:36.428231 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-df3bf67e-4c1a-4ea5-b8f2-fae6b9b59b1c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:36.439270 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df3bf67e-4c1a-4ea5-b8f2-fae6b9b59b1c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:36.440196 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df3bf67e-4c1a-4ea5-b8f2-fae6b9b59b1c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:36.441650 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df3bf67e-4c1a-4ea5-b8f2-fae6b9b59b1c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:36.447466 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df3bf67e-4c1a-4ea5-b8f2-fae6b9b59b1c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:36.447466 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df3bf67e-4c1a-4ea5-b8f2-fae6b9b59b1c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:36.447466 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df3bf67e-4c1a-4ea5-b8f2-fae6b9b59b1c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:36.465393 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-df3bf67e-4c1a-4ea5-b8f2-fae6b9b59b1c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] HTTP exception thrown: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-df3bf67e-4c1a-4ea5-b8f2-fae6b9b59b1c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Request method failure captured: Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 HTTP/1.1 Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xLFyP3sazpo8lNxFPukerJWviDoPTaEBmzGGnNT2hK_WSNwW1QEyJSvA7cujhX4n3KzSw_ywGF8KgQMwv_P1bklerqKHJCnSQNmsRxQWmDXBuOt_ZETYxuWcB2qstyCMegdrnu-rvFjhw-dLXTo-dX3Y3VP9AGooFNTG8HqCGsto4 Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:36:36.467179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:36:36.470099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6436020e938047408d1f979e23dd48da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6436020e938047408d1f979e23dd48da", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:36:36.470099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:36:36.470099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:36:36.470099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:36:36.470099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:36:36.470099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:36:36.470099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:36:36.470099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: b0db362075b04b2294a6268576a5bba3 Aug 22 17:36:36.470099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:36:36.470099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:36:36.470099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:36:36.470099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': 'da06f40f-ae38-492b-8867-2ffe54655d17'} Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:36:36.472381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:36:36.475478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:36:36.478822 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-df3bf67e-4c1a-4ea5-b8f2-fae6b9b59b1c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Returning 404 to user: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:36:36.478822 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-df3bf67e-4c1a-4ea5-b8f2-fae6b9b59b1c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 404 len: 111 microversion: 2.1 time: 0.363332 Aug 22 17:36:36.478822 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 414/830] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:36 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 111 bytes in 370 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:36:36.490517 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a41da8b3-6274-4b60-b456-da1106b1f117 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '.version_select at 0x7f0e5c6610d0>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:36.598126 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a41da8b3-6274-4b60-b456-da1106b1f117 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-248505279" status: 202 len: 0 microversion: 2.1 time: 0.120903 Aug 22 17:36:36.599909 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 417/831] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 22 17:36:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-248505279 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:36:37.174359 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-03e31540-550d-453b-9a15-1759528eff37 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:37.176012 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-03e31540-550d-453b-9a15-1759528eff37 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:37.183446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-03e31540-550d-453b-9a15-1759528eff37 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:37.183944 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-03e31540-550d-453b-9a15-1759528eff37 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:37.184386 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-03e31540-550d-453b-9a15-1759528eff37 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:37.185109 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-03e31540-550d-453b-9a15-1759528eff37 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:37.185572 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-03e31540-550d-453b-9a15-1759528eff37 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:37.186010 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-03e31540-550d-453b-9a15-1759528eff37 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:37.415297 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-03e31540-550d-453b-9a15-1759528eff37 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:37.429319 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-03e31540-550d-453b-9a15-1759528eff37 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1554 microversion: 2.1 time: 0.259107 Aug 22 17:36:37.430167 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 415/832] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:37 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1554 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:37.637313 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c6bf8325-24da-4976-88ae-bfc42f705709 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Action: 'create', calling method: .version_select at 0x7f0e5c5c7dc0>, body: {"keypair": {"name": "tempest-keypair-186687179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjqIbn/wyY9MS/TdM1rijDOGhMnI6OH0DoVj+x3KrcNsH8NdbzhZtVrSX+b8cypsIbd+L06wdtQB/+F7N2FSzMuLZZ5Pm9yf4/RAS5DyY6MVQqH3jMGEgsPU5g9qGEIaw=="}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:36:37.662503 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-c6bf8325-24da-4976-88ae-bfc42f705709 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for project 6436020e938047408d1f979e23dd48da. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:36:37.667470 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-c6bf8325-24da-4976-88ae-bfc42f705709 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for user b0db362075b04b2294a6268576a5bba3 and project 6436020e938047408d1f979e23dd48da. Resources: {'key_pairs'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:36:37.799333 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c6bf8325-24da-4976-88ae-bfc42f705709 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.167836 Aug 22 17:36:37.799976 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 418/833] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 22 17:36:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:36:38.465265 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8ea0d1ec-f1dc-49d2-ba96-108b73f8a121 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:38.470088 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8ea0d1ec-f1dc-49d2-ba96-108b73f8a121 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:38.478358 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-503a9d5c-2b36-4997-b1a7-d0723df594ab tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:38.480573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-503a9d5c-2b36-4997-b1a7-d0723df594ab tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:38.492365 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ea0d1ec-f1dc-49d2-ba96-108b73f8a121 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:38.494648 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ea0d1ec-f1dc-49d2-ba96-108b73f8a121 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:38.494648 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ea0d1ec-f1dc-49d2-ba96-108b73f8a121 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:38.496124 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ea0d1ec-f1dc-49d2-ba96-108b73f8a121 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:38.496806 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ea0d1ec-f1dc-49d2-ba96-108b73f8a121 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:38.497632 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8ea0d1ec-f1dc-49d2-ba96-108b73f8a121 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:38.510206 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-503a9d5c-2b36-4997-b1a7-d0723df594ab tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:38.511157 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-503a9d5c-2b36-4997-b1a7-d0723df594ab tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:38.511885 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-503a9d5c-2b36-4997-b1a7-d0723df594ab tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:38.513233 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-503a9d5c-2b36-4997-b1a7-d0723df594ab tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:38.514076 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-503a9d5c-2b36-4997-b1a7-d0723df594ab tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:38.515211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-503a9d5c-2b36-4997-b1a7-d0723df594ab tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:38.557888 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-503a9d5c-2b36-4997-b1a7-d0723df594ab tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da/ips" status: 200 len: 151 microversion: 2.20 time: 0.096660 Aug 22 17:36:38.558667 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 419/834] 10.222.0.20 () {60 vars in 1289 bytes} [Mon Aug 22 17:36:38 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da/ips => generated 151 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 22 17:36:38.751590 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8ea0d1ec-f1dc-49d2-ba96-108b73f8a121 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:38.765332 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8ea0d1ec-f1dc-49d2-ba96-108b73f8a121 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1554 microversion: 2.1 time: 0.312880 Aug 22 17:36:38.774915 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 416/835] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:38 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1554 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:38.974182 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-e9518967-1529-47f8-b620-a9ce0b7b8b10 req-d42d6b7c-c006-4fec-8d08-635f15b34e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84ff94bc-e986-4201-96e7-484c08490011", "name": "network-vif-deleted", "tag": "a4e21f10-9c29-4641-93d3-684817ef690e"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:36:38.985109 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-e9518967-1529-47f8-b620-a9ce0b7b8b10 req-d42d6b7c-c006-4fec-8d08-635f15b34e28 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:38.985985 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-e9518967-1529-47f8-b620-a9ce0b7b8b10 req-d42d6b7c-c006-4fec-8d08-635f15b34e28 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:38.986455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-e9518967-1529-47f8-b620-a9ce0b7b8b10 req-d42d6b7c-c006-4fec-8d08-635f15b34e28 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:39.002131 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-e9518967-1529-47f8-b620-a9ce0b7b8b10 req-d42d6b7c-c006-4fec-8d08-635f15b34e28 service nova] Creating event network-vif-deleted:a4e21f10-9c29-4641-93d3-684817ef690e for instance 84ff94bc-e986-4201-96e7-484c08490011 on hv-cinder-85394 Aug 22 17:36:39.008070 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-e9518967-1529-47f8-b620-a9ce0b7b8b10 req-d42d6b7c-c006-4fec-8d08-635f15b34e28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038029 Aug 22 17:36:39.008648 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 420/836] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:36:39.791670 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d411f61d-f0bb-4082-bdbb-b4fe1002893b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:39.793326 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d411f61d-f0bb-4082-bdbb-b4fe1002893b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:39.820728 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d411f61d-f0bb-4082-bdbb-b4fe1002893b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:39.825268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d411f61d-f0bb-4082-bdbb-b4fe1002893b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:39.825997 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d411f61d-f0bb-4082-bdbb-b4fe1002893b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:39.827441 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d411f61d-f0bb-4082-bdbb-b4fe1002893b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:39.828193 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d411f61d-f0bb-4082-bdbb-b4fe1002893b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:39.838258 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d411f61d-f0bb-4082-bdbb-b4fe1002893b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:39.854283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:36:39.880198 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d411f61d-f0bb-4082-bdbb-b4fe1002893b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:39.881708 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d411f61d-f0bb-4082-bdbb-b4fe1002893b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:39.882501 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d411f61d-f0bb-4082-bdbb-b4fe1002893b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:39.883408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-d411f61d-f0bb-4082-bdbb-b4fe1002893b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lazy-loading 'fault' on Instance uuid 84ff94bc-e986-4201-96e7-484c08490011 {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:36:39.944456 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-d411f61d-f0bb-4082-bdbb-b4fe1002893b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aff4cd6b5ec14cb29813416b1d929333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11871f979145455499b30912da1abcfd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:39.954898 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d411f61d-f0bb-4082-bdbb-b4fe1002893b tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 200 len: 1348 microversion: 2.1 time: 0.166989 Aug 22 17:36:39.955731 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 417/837] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:39 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 1348 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:40.981984 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cd453c20-6e8c-4deb-a213-9d6cae0d694c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:40.983558 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-cd453c20-6e8c-4deb-a213-9d6cae0d694c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] [instance: 84ff94bc-e986-4201-96e7-484c08490011] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:40.991914 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cd453c20-6e8c-4deb-a213-9d6cae0d694c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:40.992418 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cd453c20-6e8c-4deb-a213-9d6cae0d694c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:40.993136 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cd453c20-6e8c-4deb-a213-9d6cae0d694c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:40.993887 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cd453c20-6e8c-4deb-a213-9d6cae0d694c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:40.994368 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cd453c20-6e8c-4deb-a213-9d6cae0d694c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:40.994855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cd453c20-6e8c-4deb-a213-9d6cae0d694c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:41.010748 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-cd453c20-6e8c-4deb-a213-9d6cae0d694c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] HTTP exception thrown: Instance 84ff94bc-e986-4201-96e7-484c08490011 could not be found. Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cd453c20-6e8c-4deb-a213-9d6cae0d694c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Request method failure captured: Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 HTTP/1.1 Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA72P1-I5CB4aNWzdttkwObwrRg8hg3DjQEXYTcEuh9nQSpAXLZm8FphbKndW9CHExIDxc9VdXZEPUXkkAw3AVf1H6fCXEtf45Q3xUX2wKLdNbV89YHtmPUQbnK7j0k5PQOyoBo-_-g3tBnBmlBZip7K3UJ8J3HHAdKouUl3yENvTmsM Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 11871f979145455499b30912da1abcfd Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-TestMinimumBasicScenario-1698294823 Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:36:41.012465 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:36:41.015250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/11871f979145455499b30912da1abcfd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/11871f979145455499b30912da1abcfd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/11871f979145455499b30912da1abcfd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_11871f979145455499b30912da1abcfd", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:36:41.015250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-TestMinimumBasicScenario-1698294823 Aug 22 17:36:41.015250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 11871f979145455499b30912da1abcfd Aug 22 17:36:41.015250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1698294823 Aug 22 17:36:41.015250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-TestMinimumBasicScenario-1698294823-project Aug 22 17:36:41.015250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:36:41.015250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:36:41.015250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: aff4cd6b5ec14cb29813416b1d929333 Aug 22 17:36:41.015250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-TestMinimumBasicScenario-1698294823-project Aug 22 17:36:41.015250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:36:41.015250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance 84ff94bc-e986-4201-96e7-484c08490011 could not be found. Aug 22 17:36:41.015250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': '84ff94bc-e986-4201-96e7-484c08490011'} Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 84ff94bc-e986-4201-96e7-484c08490011 could not be found. Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:36:41.016745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 84ff94bc-e986-4201-96e7-484c08490011 could not be found. Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 84ff94bc-e986-4201-96e7-484c08490011 could not be found. Aug 22 17:36:41.020245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:36:41.022781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cd453c20-6e8c-4deb-a213-9d6cae0d694c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Returning 404 to user: Instance 84ff94bc-e986-4201-96e7-484c08490011 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:36:41.022781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-cd453c20-6e8c-4deb-a213-9d6cae0d694c tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011" status: 404 len: 111 microversion: 2.1 time: 0.037930 Aug 22 17:36:41.022781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 421/838] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:40 2022] GET /compute/v2.1/servers/84ff94bc-e986-4201-96e7-484c08490011 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:36:41.025969 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-53df27a1-f2d2-456c-832a-6e27ead24c64 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] Calling method '.version_select at 0x7f0e60df3310>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:41.142280 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1954393401", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab7e148b-b163-4e14-9626-bb3c240fc395"}], "security_groups": [{"name": "tempest-securitygroup--200125589"}], "key_name": "tempest-keypair-186687179", "user_data": "}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:36:41.152030 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-53df27a1-f2d2-456c-832a-6e27ead24c64 tempest-TestMinimumBasicScenario-1698294823 tempest-TestMinimumBasicScenario-1698294823-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-611220326" status: 202 len: 0 microversion: 2.1 time: 0.131030 Aug 22 17:36:41.152965 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 418/839] 10.222.0.20 () {58 vars in 1269 bytes} [Mon Aug 22 17:36:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-611220326 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:36:42.779387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c6895974-e717-42a0-9822-549c9ca2f55a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:36:42.780934 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c6895974-e717-42a0-9822-549c9ca2f55a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:42.788986 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6895974-e717-42a0-9822-549c9ca2f55a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:42.789487 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6895974-e717-42a0-9822-549c9ca2f55a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:42.789926 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6895974-e717-42a0-9822-549c9ca2f55a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:42.790732 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6895974-e717-42a0-9822-549c9ca2f55a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:42.791190 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6895974-e717-42a0-9822-549c9ca2f55a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:42.791823 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c6895974-e717-42a0-9822-549c9ca2f55a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:42.829714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-c6895974-e717-42a0-9822-549c9ca2f55a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lazy-loading 'flavor' on Instance uuid 01a67bb4-4540-4e14-a7bc-74bf8ca080da {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:36:42.932072 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.network.neutron [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] validate_networks() for [('ab7e148b-b163-4e14-9626-bb3c240fc395', None, None, None, None, None)] {{(pid=121853) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:36:43.435459 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c6895974-e717-42a0-9822-549c9ca2f55a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "POST /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da/action" status: 202 len: 0 microversion: 2.20 time: 0.660858 Aug 22 17:36:43.436457 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 419/840] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 22 17:36:42 2022] POST /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da/action => generated 0 bytes in 663 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 22 17:36:43.447457 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b066e1ab-2967-4781-b07e-e6da32713802 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:43.449299 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b066e1ab-2967-4781-b07e-e6da32713802 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:43.455524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b066e1ab-2967-4781-b07e-e6da32713802 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:43.456580 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b066e1ab-2967-4781-b07e-e6da32713802 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:43.457061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b066e1ab-2967-4781-b07e-e6da32713802 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:43.457826 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b066e1ab-2967-4781-b07e-e6da32713802 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:43.458298 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b066e1ab-2967-4781-b07e-e6da32713802 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:43.458767 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b066e1ab-2967-4781-b07e-e6da32713802 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:43.649274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b066e1ab-2967-4781-b07e-e6da32713802 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:43.667217 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b066e1ab-2967-4781-b07e-e6da32713802 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:43.671490 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b066e1ab-2967-4781-b07e-e6da32713802 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:43.673335 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b066e1ab-2967-4781-b07e-e6da32713802 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1721 microversion: 2.20 time: 0.231990 Aug 22 17:36:43.681821 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 420/841] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:36:43 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:36:44.200982 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Flavor limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:36:44.201477 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Image limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:36:44.201879 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Flavor pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:36:44.202293 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Image pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:36:44.202764 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:36:44.214865 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:44.215349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:44.215955 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:44.216736 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:44.217224 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:44.217746 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:44.236965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for project 6436020e938047408d1f979e23dd48da. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:36:44.242855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Getting quotas for user b0db362075b04b2294a6268576a5bba3 and project 6436020e938047408d1f979e23dd48da. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:36:44.259898 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Going to run 1 instances... {{(pid=121853) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:36:44.262460 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:36:44.432272 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d4630071-2d56-432f-b139-6d1c7f05870c tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.294668 Aug 22 17:36:44.434413 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 422/842] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:36:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 3298 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 17:36:44.450883 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-cd5e9e5a-7fe1-4b5c-8f23-a569ef8f1f3e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:44.452620 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-cd5e9e5a-7fe1-4b5c-8f23-a569ef8f1f3e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:44.569151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-cd5e9e5a-7fe1-4b5c-8f23-a569ef8f1f3e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:44.582347 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-cd5e9e5a-7fe1-4b5c-8f23-a569ef8f1f3e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1241 microversion: 2.1 time: 0.135498 Aug 22 17:36:44.583460 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 421/843] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:44 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1241 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:36:44.714329 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1f9c2af3-dcd5-4346-9ff8-9156b29d4816 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:44.714931 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1f9c2af3-dcd5-4346-9ff8-9156b29d4816 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:44.722978 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1f9c2af3-dcd5-4346-9ff8-9156b29d4816 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:44.723598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1f9c2af3-dcd5-4346-9ff8-9156b29d4816 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:44.724019 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1f9c2af3-dcd5-4346-9ff8-9156b29d4816 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:44.724971 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1f9c2af3-dcd5-4346-9ff8-9156b29d4816 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:44.725656 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1f9c2af3-dcd5-4346-9ff8-9156b29d4816 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:44.726341 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1f9c2af3-dcd5-4346-9ff8-9156b29d4816 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:45.360229 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1f9c2af3-dcd5-4346-9ff8-9156b29d4816 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:45.367376 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:36:45.381068 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1f9c2af3-dcd5-4346-9ff8-9156b29d4816 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:45.383111 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1f9c2af3-dcd5-4346-9ff8-9156b29d4816 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:45.384854 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1f9c2af3-dcd5-4346-9ff8-9156b29d4816 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1721 microversion: 2.20 time: 0.674646 Aug 22 17:36:45.386083 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 423/844] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:36:44 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1721 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:36:45.612302 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9c160bfb-81c7-4be8-8d7a-07f20f8eca18 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:45.613133 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9c160bfb-81c7-4be8-8d7a-07f20f8eca18 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:45.695691 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9c160bfb-81c7-4be8-8d7a-07f20f8eca18 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:45.704655 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9c160bfb-81c7-4be8-8d7a-07f20f8eca18 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1241 microversion: 2.1 time: 0.096330 Aug 22 17:36:45.705661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 422/845] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:45 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:46.423734 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-26e7b246-8228-4494-9080-2081f76c32b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:46.425013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-26e7b246-8228-4494-9080-2081f76c32b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:46.439447 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-26e7b246-8228-4494-9080-2081f76c32b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:46.441259 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-26e7b246-8228-4494-9080-2081f76c32b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:46.442430 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-26e7b246-8228-4494-9080-2081f76c32b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:46.444152 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-26e7b246-8228-4494-9080-2081f76c32b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:46.445377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-26e7b246-8228-4494-9080-2081f76c32b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:46.446632 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-26e7b246-8228-4494-9080-2081f76c32b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:46.738051 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-09bde76a-23ea-4359-ac1f-3d7b81aa4963 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:46.738051 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-09bde76a-23ea-4359-ac1f-3d7b81aa4963 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:46.744784 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09bde76a-23ea-4359-ac1f-3d7b81aa4963 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:46.745398 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09bde76a-23ea-4359-ac1f-3d7b81aa4963 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:46.746203 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09bde76a-23ea-4359-ac1f-3d7b81aa4963 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:46.747228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09bde76a-23ea-4359-ac1f-3d7b81aa4963 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:46.747948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09bde76a-23ea-4359-ac1f-3d7b81aa4963 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:46.748464 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09bde76a-23ea-4359-ac1f-3d7b81aa4963 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:46.818078 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-09bde76a-23ea-4359-ac1f-3d7b81aa4963 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:46.832741 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-09bde76a-23ea-4359-ac1f-3d7b81aa4963 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1293 microversion: 2.1 time: 0.102907 Aug 22 17:36:46.833831 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 423/846] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:46 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:36:46.852335 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-26e7b246-8228-4494-9080-2081f76c32b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:46.863905 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-26e7b246-8228-4494-9080-2081f76c32b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:46.865643 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-26e7b246-8228-4494-9080-2081f76c32b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:46.867062 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-26e7b246-8228-4494-9080-2081f76c32b2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1721 microversion: 2.20 time: 0.451772 Aug 22 17:36:46.868026 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 424/847] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:36:46 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1721 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:36:47.869285 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-81cf4332-e5c2-4ad5-9269-4347456a81f2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:47.869971 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-81cf4332-e5c2-4ad5-9269-4347456a81f2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:47.883229 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81cf4332-e5c2-4ad5-9269-4347456a81f2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:47.884455 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81cf4332-e5c2-4ad5-9269-4347456a81f2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:47.885474 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81cf4332-e5c2-4ad5-9269-4347456a81f2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:47.887066 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81cf4332-e5c2-4ad5-9269-4347456a81f2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:47.888370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81cf4332-e5c2-4ad5-9269-4347456a81f2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:47.889637 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-81cf4332-e5c2-4ad5-9269-4347456a81f2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:47.913865 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c68c0766-d836-422d-8246-4d1662722d8f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:47.914924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c68c0766-d836-422d-8246-4d1662722d8f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:47.927071 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c68c0766-d836-422d-8246-4d1662722d8f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:47.927561 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c68c0766-d836-422d-8246-4d1662722d8f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:47.928128 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c68c0766-d836-422d-8246-4d1662722d8f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:47.928741 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c68c0766-d836-422d-8246-4d1662722d8f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:47.929203 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c68c0766-d836-422d-8246-4d1662722d8f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:47.929617 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c68c0766-d836-422d-8246-4d1662722d8f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:48.044848 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-81cf4332-e5c2-4ad5-9269-4347456a81f2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:48.059260 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-81cf4332-e5c2-4ad5-9269-4347456a81f2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1299 microversion: 2.1 time: 0.204633 Aug 22 17:36:48.059867 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 424/848] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:47 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1299 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:48.276845 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c68c0766-d836-422d-8246-4d1662722d8f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:48.292863 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c68c0766-d836-422d-8246-4d1662722d8f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:48.292863 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c68c0766-d836-422d-8246-4d1662722d8f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:48.292863 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c68c0766-d836-422d-8246-4d1662722d8f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1721 microversion: 2.20 time: 0.401616 Aug 22 17:36:48.303272 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 425/849] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:36:47 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1721 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:36:49.113300 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-49e81aad-b1ad-435b-bd6b-5b71b7b8caba tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:49.115738 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-49e81aad-b1ad-435b-bd6b-5b71b7b8caba tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:49.129880 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-49e81aad-b1ad-435b-bd6b-5b71b7b8caba tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:49.131622 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-49e81aad-b1ad-435b-bd6b-5b71b7b8caba tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:49.132670 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-49e81aad-b1ad-435b-bd6b-5b71b7b8caba tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:49.134140 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-49e81aad-b1ad-435b-bd6b-5b71b7b8caba tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:49.135193 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-49e81aad-b1ad-435b-bd6b-5b71b7b8caba tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:49.136214 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-49e81aad-b1ad-435b-bd6b-5b71b7b8caba tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:49.324108 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4cd38c41-17ca-460e-962c-e1ca3bf2e590 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:49.326426 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4cd38c41-17ca-460e-962c-e1ca3bf2e590 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:49.340923 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4cd38c41-17ca-460e-962c-e1ca3bf2e590 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:49.342731 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4cd38c41-17ca-460e-962c-e1ca3bf2e590 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:49.343635 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4cd38c41-17ca-460e-962c-e1ca3bf2e590 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:49.345183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4cd38c41-17ca-460e-962c-e1ca3bf2e590 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:49.346299 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4cd38c41-17ca-460e-962c-e1ca3bf2e590 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:49.349395 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4cd38c41-17ca-460e-962c-e1ca3bf2e590 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:49.543633 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-49e81aad-b1ad-435b-bd6b-5b71b7b8caba tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:49.553459 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-49e81aad-b1ad-435b-bd6b-5b71b7b8caba tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1366 microversion: 2.1 time: 0.449636 Aug 22 17:36:49.554085 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 425/850] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:49 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1366 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:49.603422 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4cd38c41-17ca-460e-962c-e1ca3bf2e590 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:49.613147 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4cd38c41-17ca-460e-962c-e1ca3bf2e590 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:49.614765 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4cd38c41-17ca-460e-962c-e1ca3bf2e590 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:49.615987 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4cd38c41-17ca-460e-962c-e1ca3bf2e590 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1721 microversion: 2.20 time: 0.301982 Aug 22 17:36:49.616735 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 426/851] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:36:49 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1721 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:36:50.575731 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f09f7d1d-ed42-405f-82b1-e89046504aca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:50.576395 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f09f7d1d-ed42-405f-82b1-e89046504aca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:50.585279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f09f7d1d-ed42-405f-82b1-e89046504aca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:50.586180 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f09f7d1d-ed42-405f-82b1-e89046504aca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:50.587006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f09f7d1d-ed42-405f-82b1-e89046504aca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:50.588287 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f09f7d1d-ed42-405f-82b1-e89046504aca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:50.589160 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f09f7d1d-ed42-405f-82b1-e89046504aca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:50.589941 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f09f7d1d-ed42-405f-82b1-e89046504aca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:50.659159 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0305939f-478e-4165-95d8-8840d9e38cc9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:50.661998 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0305939f-478e-4165-95d8-8840d9e38cc9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:50.671243 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0305939f-478e-4165-95d8-8840d9e38cc9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:50.672159 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0305939f-478e-4165-95d8-8840d9e38cc9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:50.672863 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0305939f-478e-4165-95d8-8840d9e38cc9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:50.673806 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0305939f-478e-4165-95d8-8840d9e38cc9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:50.674585 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0305939f-478e-4165-95d8-8840d9e38cc9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:50.675306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0305939f-478e-4165-95d8-8840d9e38cc9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:50.810290 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f09f7d1d-ed42-405f-82b1-e89046504aca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:50.826761 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f09f7d1d-ed42-405f-82b1-e89046504aca tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1366 microversion: 2.1 time: 0.254856 Aug 22 17:36:50.827933 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 426/852] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:50 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:50.837875 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-b1d9f5f5-dbd6-4332-bd14-b07777379cbc req-e01e89ce-364a-44cc-bab6-b4a51570a5ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807e63ee-52a6-4bcc-bc90-d492fff06ad6", "tag": "fe1e7627-2a87-4924-873f-5bc0f6035f49"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:36:50.855888 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-b1d9f5f5-dbd6-4332-bd14-b07777379cbc req-e01e89ce-364a-44cc-bab6-b4a51570a5ad service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:50.856851 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-b1d9f5f5-dbd6-4332-bd14-b07777379cbc req-e01e89ce-364a-44cc-bab6-b4a51570a5ad service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:50.857624 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-b1d9f5f5-dbd6-4332-bd14-b07777379cbc req-e01e89ce-364a-44cc-bab6-b4a51570a5ad service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:50.881647 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-b1d9f5f5-dbd6-4332-bd14-b07777379cbc req-e01e89ce-364a-44cc-bab6-b4a51570a5ad service nova] Creating event network-changed:fe1e7627-2a87-4924-873f-5bc0f6035f49 for instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 on hv-cinder-85394 Aug 22 17:36:50.892065 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-b1d9f5f5-dbd6-4332-bd14-b07777379cbc req-e01e89ce-364a-44cc-bab6-b4a51570a5ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061617 Aug 22 17:36:50.893981 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 427/853] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:36:51.069798 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0305939f-478e-4165-95d8-8840d9e38cc9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:51.082829 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0305939f-478e-4165-95d8-8840d9e38cc9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:51.085840 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0305939f-478e-4165-95d8-8840d9e38cc9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:51.087900 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0305939f-478e-4165-95d8-8840d9e38cc9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1721 microversion: 2.20 time: 0.436873 Aug 22 17:36:51.088840 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 427/854] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:36:50 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1721 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:36:51.851385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8510b353-445d-474f-80f1-da4bed037337 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:51.852753 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8510b353-445d-474f-80f1-da4bed037337 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:51.860184 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8510b353-445d-474f-80f1-da4bed037337 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:51.860679 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8510b353-445d-474f-80f1-da4bed037337 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:51.861115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8510b353-445d-474f-80f1-da4bed037337 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:51.861832 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8510b353-445d-474f-80f1-da4bed037337 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:51.863214 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8510b353-445d-474f-80f1-da4bed037337 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:51.863636 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8510b353-445d-474f-80f1-da4bed037337 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:52.043884 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8510b353-445d-474f-80f1-da4bed037337 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:52.055072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8510b353-445d-474f-80f1-da4bed037337 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1366 microversion: 2.1 time: 0.209183 Aug 22 17:36:52.056566 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 428/855] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:51 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:52.118122 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d5013a13-b933-4915-ab73-2b2f8083d14a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:52.118696 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d5013a13-b933-4915-ab73-2b2f8083d14a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:52.125278 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d5013a13-b933-4915-ab73-2b2f8083d14a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:52.125764 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d5013a13-b933-4915-ab73-2b2f8083d14a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:52.126191 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d5013a13-b933-4915-ab73-2b2f8083d14a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:52.126943 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d5013a13-b933-4915-ab73-2b2f8083d14a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:52.127394 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d5013a13-b933-4915-ab73-2b2f8083d14a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:52.128307 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d5013a13-b933-4915-ab73-2b2f8083d14a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:52.303112 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d5013a13-b933-4915-ab73-2b2f8083d14a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:52.312278 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d5013a13-b933-4915-ab73-2b2f8083d14a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:52.313836 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-d5013a13-b933-4915-ab73-2b2f8083d14a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:52.315837 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d5013a13-b933-4915-ab73-2b2f8083d14a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1721 microversion: 2.20 time: 0.201203 Aug 22 17:36:52.316894 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 428/856] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:36:52 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:36:53.106080 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c3c8dec5-bfa9-49f0-98ae-2be5991564d1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:53.106941 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c3c8dec5-bfa9-49f0-98ae-2be5991564d1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:53.114563 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c3c8dec5-bfa9-49f0-98ae-2be5991564d1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:53.115398 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c3c8dec5-bfa9-49f0-98ae-2be5991564d1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:53.119638 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c3c8dec5-bfa9-49f0-98ae-2be5991564d1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:53.119638 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c3c8dec5-bfa9-49f0-98ae-2be5991564d1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:53.119638 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c3c8dec5-bfa9-49f0-98ae-2be5991564d1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:53.119638 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c3c8dec5-bfa9-49f0-98ae-2be5991564d1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:53.323914 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c3c8dec5-bfa9-49f0-98ae-2be5991564d1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:53.335536 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c3c8dec5-bfa9-49f0-98ae-2be5991564d1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1366 microversion: 2.1 time: 0.240779 Aug 22 17:36:53.337037 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 429/857] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:53 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:53.347955 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-55d41ada-df95-45f0-a1b0-3e2d738f1030 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:53.350804 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-55d41ada-df95-45f0-a1b0-3e2d738f1030 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:53.365060 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55d41ada-df95-45f0-a1b0-3e2d738f1030 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:53.366234 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55d41ada-df95-45f0-a1b0-3e2d738f1030 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:53.367295 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55d41ada-df95-45f0-a1b0-3e2d738f1030 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:53.368244 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55d41ada-df95-45f0-a1b0-3e2d738f1030 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:53.368847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55d41ada-df95-45f0-a1b0-3e2d738f1030 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:53.369426 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-55d41ada-df95-45f0-a1b0-3e2d738f1030 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:53.666161 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-55d41ada-df95-45f0-a1b0-3e2d738f1030 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:53.675480 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-55d41ada-df95-45f0-a1b0-3e2d738f1030 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:53.677213 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-55d41ada-df95-45f0-a1b0-3e2d738f1030 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:53.678416 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-55d41ada-df95-45f0-a1b0-3e2d738f1030 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1721 microversion: 2.20 time: 0.340056 Aug 22 17:36:53.679005 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 429/858] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:36:53 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1721 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:36:54.380378 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-bd0990bb-e45f-44d7-90e8-7356d5e15603 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:54.380378 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-bd0990bb-e45f-44d7-90e8-7356d5e15603 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:54.389408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd0990bb-e45f-44d7-90e8-7356d5e15603 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:54.390291 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd0990bb-e45f-44d7-90e8-7356d5e15603 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:54.391047 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd0990bb-e45f-44d7-90e8-7356d5e15603 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:54.392300 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd0990bb-e45f-44d7-90e8-7356d5e15603 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:54.393463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd0990bb-e45f-44d7-90e8-7356d5e15603 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:54.394647 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd0990bb-e45f-44d7-90e8-7356d5e15603 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:54.668127 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-bd0990bb-e45f-44d7-90e8-7356d5e15603 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:54.680000 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-bd0990bb-e45f-44d7-90e8-7356d5e15603 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1366 microversion: 2.1 time: 0.309921 Aug 22 17:36:54.680904 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 430/859] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:54 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:54.703176 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f69b8de6-0e73-495c-bd4a-bb0f0c6efdbf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:54.703924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f69b8de6-0e73-495c-bd4a-bb0f0c6efdbf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:54.706409 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:36:54.707805 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=14 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:36:54.713760 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f69b8de6-0e73-495c-bd4a-bb0f0c6efdbf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:54.714669 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f69b8de6-0e73-495c-bd4a-bb0f0c6efdbf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:54.715350 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f69b8de6-0e73-495c-bd4a-bb0f0c6efdbf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:54.716370 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f69b8de6-0e73-495c-bd4a-bb0f0c6efdbf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:54.717103 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f69b8de6-0e73-495c-bd4a-bb0f0c6efdbf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:54.717539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f69b8de6-0e73-495c-bd4a-bb0f0c6efdbf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:54.892498 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f69b8de6-0e73-495c-bd4a-bb0f0c6efdbf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:54.901517 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f69b8de6-0e73-495c-bd4a-bb0f0c6efdbf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:54.903068 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f69b8de6-0e73-495c-bd4a-bb0f0c6efdbf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:54.904257 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f69b8de6-0e73-495c-bd4a-bb0f0c6efdbf tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1721 microversion: 2.20 time: 0.205434 Aug 22 17:36:54.904817 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 430/860] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:36:54 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:36:55.704722 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5927fd5f-88fe-4569-999f-53b19d9fb3e3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:55.704722 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5927fd5f-88fe-4569-999f-53b19d9fb3e3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:55.705642 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=4 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:36:55.711304 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5927fd5f-88fe-4569-999f-53b19d9fb3e3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:55.711795 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5927fd5f-88fe-4569-999f-53b19d9fb3e3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:55.712222 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5927fd5f-88fe-4569-999f-53b19d9fb3e3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:55.712923 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5927fd5f-88fe-4569-999f-53b19d9fb3e3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:55.713363 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5927fd5f-88fe-4569-999f-53b19d9fb3e3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:55.713783 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5927fd5f-88fe-4569-999f-53b19d9fb3e3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:55.904057 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5927fd5f-88fe-4569-999f-53b19d9fb3e3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:55.914018 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5927fd5f-88fe-4569-999f-53b19d9fb3e3 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1366 microversion: 2.1 time: 0.215606 Aug 22 17:36:55.914579 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 431/861] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:55 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:55.927947 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-77aac78b-83cf-4c5b-90c9-ea2360a60a82 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:55.928568 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-77aac78b-83cf-4c5b-90c9-ea2360a60a82 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:55.931373 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:36:55.936190 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-77aac78b-83cf-4c5b-90c9-ea2360a60a82 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:55.936703 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-77aac78b-83cf-4c5b-90c9-ea2360a60a82 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:55.940528 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-77aac78b-83cf-4c5b-90c9-ea2360a60a82 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:55.940528 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-77aac78b-83cf-4c5b-90c9-ea2360a60a82 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:55.940528 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-77aac78b-83cf-4c5b-90c9-ea2360a60a82 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:55.940528 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-77aac78b-83cf-4c5b-90c9-ea2360a60a82 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:56.097411 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-77aac78b-83cf-4c5b-90c9-ea2360a60a82 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:56.107299 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-77aac78b-83cf-4c5b-90c9-ea2360a60a82 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:56.108903 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-77aac78b-83cf-4c5b-90c9-ea2360a60a82 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:56.110124 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-77aac78b-83cf-4c5b-90c9-ea2360a60a82 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1721 microversion: 2.20 time: 0.186515 Aug 22 17:36:56.110712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 431/862] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:36:55 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:36:56.936610 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2accada2-206d-445f-b9f7-b95421c0d746 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:56.937737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-2accada2-206d-445f-b9f7-b95421c0d746 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:56.941156 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:36:56.944844 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2accada2-206d-445f-b9f7-b95421c0d746 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:56.945347 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2accada2-206d-445f-b9f7-b95421c0d746 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:56.945787 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2accada2-206d-445f-b9f7-b95421c0d746 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:56.946525 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2accada2-206d-445f-b9f7-b95421c0d746 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:56.947012 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2accada2-206d-445f-b9f7-b95421c0d746 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:56.947440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2accada2-206d-445f-b9f7-b95421c0d746 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:57.104125 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2accada2-206d-445f-b9f7-b95421c0d746 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:57.112365 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2accada2-206d-445f-b9f7-b95421c0d746 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1366 microversion: 2.1 time: 0.179685 Aug 22 17:36:57.112977 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 432/863] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:56 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:57.135809 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-acee1c93-6a7a-4454-9941-c92e890dda39 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:57.136409 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-acee1c93-6a7a-4454-9941-c92e890dda39 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:57.144071 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-acee1c93-6a7a-4454-9941-c92e890dda39 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:57.144595 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-acee1c93-6a7a-4454-9941-c92e890dda39 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:57.145114 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-acee1c93-6a7a-4454-9941-c92e890dda39 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:57.145831 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-acee1c93-6a7a-4454-9941-c92e890dda39 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:57.146290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-acee1c93-6a7a-4454-9941-c92e890dda39 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:57.146758 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-acee1c93-6a7a-4454-9941-c92e890dda39 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:57.337993 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-acee1c93-6a7a-4454-9941-c92e890dda39 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:57.349063 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-acee1c93-6a7a-4454-9941-c92e890dda39 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:57.350660 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-acee1c93-6a7a-4454-9941-c92e890dda39 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:57.351898 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-acee1c93-6a7a-4454-9941-c92e890dda39 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1721 microversion: 2.20 time: 0.220574 Aug 22 17:36:57.352827 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 432/864] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:36:57 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:36:58.137986 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-864deffc-5b51-4c1d-a547-2a5de19b8f8d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:58.138899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-864deffc-5b51-4c1d-a547-2a5de19b8f8d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:58.148052 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-864deffc-5b51-4c1d-a547-2a5de19b8f8d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:58.148984 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-864deffc-5b51-4c1d-a547-2a5de19b8f8d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:58.155077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-864deffc-5b51-4c1d-a547-2a5de19b8f8d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:58.155077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-864deffc-5b51-4c1d-a547-2a5de19b8f8d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:58.155077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-864deffc-5b51-4c1d-a547-2a5de19b8f8d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:58.155077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-864deffc-5b51-4c1d-a547-2a5de19b8f8d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:58.365532 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-864deffc-5b51-4c1d-a547-2a5de19b8f8d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:58.376037 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b0b1b193-2980-4d8f-9d59-e29f1adb8371 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:58.378007 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b0b1b193-2980-4d8f-9d59-e29f1adb8371 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:58.383655 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-864deffc-5b51-4c1d-a547-2a5de19b8f8d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1366 microversion: 2.1 time: 0.250658 Aug 22 17:36:58.384434 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 433/865] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:58 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1366 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:58.387930 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b0b1b193-2980-4d8f-9d59-e29f1adb8371 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:58.388516 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b0b1b193-2980-4d8f-9d59-e29f1adb8371 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:58.388894 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b0b1b193-2980-4d8f-9d59-e29f1adb8371 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:58.389622 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b0b1b193-2980-4d8f-9d59-e29f1adb8371 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:58.390077 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b0b1b193-2980-4d8f-9d59-e29f1adb8371 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:58.390528 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b0b1b193-2980-4d8f-9d59-e29f1adb8371 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:58.558711 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b0b1b193-2980-4d8f-9d59-e29f1adb8371 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:58.568847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b0b1b193-2980-4d8f-9d59-e29f1adb8371 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:58.570909 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b0b1b193-2980-4d8f-9d59-e29f1adb8371 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:58.572436 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b0b1b193-2980-4d8f-9d59-e29f1adb8371 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1721 microversion: 2.20 time: 0.200462 Aug 22 17:36:58.573010 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 433/866] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:36:58 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:36:59.417691 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8d073a23-3751-4738-b3fe-1a92e533d63f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:59.424495 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8d073a23-3751-4738-b3fe-1a92e533d63f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:59.427769 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8d073a23-3751-4738-b3fe-1a92e533d63f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:59.428576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8d073a23-3751-4738-b3fe-1a92e533d63f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:59.429277 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8d073a23-3751-4738-b3fe-1a92e533d63f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:59.430444 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8d073a23-3751-4738-b3fe-1a92e533d63f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:59.431272 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8d073a23-3751-4738-b3fe-1a92e533d63f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:59.431946 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8d073a23-3751-4738-b3fe-1a92e533d63f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:59.435242 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1484741899", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1343415650", "security_groups": [{"name": "tempest-secgroup-smoke-1211405103"}], "networks": [{"uuid": "add64590-2242-4d8d-809a-10a30cd25ecc"}], "block_device_mapping_v2": [{"uuid": "1046332a-c39d-4529-828c-90f97595addf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:36:59.567017 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.network.neutron [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] validate_networks() for [('add64590-2242-4d8d-809a-10a30cd25ecc', None, None, None, None, None)] {{(pid=121853) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:36:59.607501 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8d073a23-3751-4738-b3fe-1a92e533d63f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:59.618373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8d073a23-3751-4738-b3fe-1a92e533d63f tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1366 microversion: 2.1 time: 0.204755 Aug 22 17:36:59.630784 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 434/867] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:36:59 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:36:59.630784 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b16d2c33-5346-445c-a15a-85e81407dc63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:36:59.630784 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b16d2c33-5346-445c-a15a-85e81407dc63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:36:59.641611 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b16d2c33-5346-445c-a15a-85e81407dc63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:59.644529 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b16d2c33-5346-445c-a15a-85e81407dc63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:59.644529 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b16d2c33-5346-445c-a15a-85e81407dc63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:59.645241 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b16d2c33-5346-445c-a15a-85e81407dc63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:36:59.646079 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b16d2c33-5346-445c-a15a-85e81407dc63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:36:59.646882 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b16d2c33-5346-445c-a15a-85e81407dc63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:36:59.669422 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:36:59.818759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b16d2c33-5346-445c-a15a-85e81407dc63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:59.829229 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b16d2c33-5346-445c-a15a-85e81407dc63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:59.831601 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b16d2c33-5346-445c-a15a-85e81407dc63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:36:59.832873 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b16d2c33-5346-445c-a15a-85e81407dc63 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1742 microversion: 2.20 time: 0.212150 Aug 22 17:36:59.833469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 435/868] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:36:59 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1742 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:00.056315 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Flavor limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:37:00.056820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Image limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:37:00.057643 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Flavor pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:37:00.058246 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Image pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:37:00.058941 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:37:00.073040 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:00.073891 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:00.074719 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:00.076041 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:00.076860 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:00.077385 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:00.109799 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Getting quotas for project 608e3c25b97f4a75b2a80903a9d5c656. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:37:00.117788 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Getting quotas for user 9454a7a736164ff09382babab30694d8 and project 608e3c25b97f4a75b2a80903a9d5c656. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:37:00.195752 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Going to run 1 instances... {{(pid=121853) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:37:00.203747 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1046332a-c39d-4529-828c-90f97595addf',volume_size=None,volume_type=None)] {{(pid=121853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:37:00.660313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a9301622-6c9f-4fb2-90e4-7b71df1a7733 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:00.662011 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a9301622-6c9f-4fb2-90e4-7b71df1a7733 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:00.674639 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9301622-6c9f-4fb2-90e4-7b71df1a7733 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:00.675535 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9301622-6c9f-4fb2-90e4-7b71df1a7733 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:00.676260 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9301622-6c9f-4fb2-90e4-7b71df1a7733 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:00.677523 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9301622-6c9f-4fb2-90e4-7b71df1a7733 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:00.678373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9301622-6c9f-4fb2-90e4-7b71df1a7733 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:00.679175 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9301622-6c9f-4fb2-90e4-7b71df1a7733 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:00.770647 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5c325f8e-9479-4391-a16c-70d191eaf5f0 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.342053 Aug 22 17:37:00.773211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 434/869] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:36:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 17:37:00.791260 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-7ed3474c-bc6a-4c56-9e0e-1fc67424d238 req-d85d9916-592c-44c6-b80b-44d9157993a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807e63ee-52a6-4bcc-bc90-d492fff06ad6", "name": "network-vif-plugged", "status": "completed", "tag": "fe1e7627-2a87-4924-873f-5bc0f6035f49"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:37:00.813071 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-7ed3474c-bc6a-4c56-9e0e-1fc67424d238 req-d85d9916-592c-44c6-b80b-44d9157993a3 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:00.814077 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-7ed3474c-bc6a-4c56-9e0e-1fc67424d238 req-d85d9916-592c-44c6-b80b-44d9157993a3 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:00.814779 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-7ed3474c-bc6a-4c56-9e0e-1fc67424d238 req-d85d9916-592c-44c6-b80b-44d9157993a3 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:00.839934 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-7ed3474c-bc6a-4c56-9e0e-1fc67424d238 req-d85d9916-592c-44c6-b80b-44d9157993a3 service nova] Creating event network-vif-plugged:fe1e7627-2a87-4924-873f-5bc0f6035f49 for instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 on hv-cinder-85394 Aug 22 17:37:00.853533 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-7ed3474c-bc6a-4c56-9e0e-1fc67424d238 req-d85d9916-592c-44c6-b80b-44d9157993a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074145 Aug 22 17:37:00.859052 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 435/870] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:37:00.871071 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b6c275db-90d5-41a6-92f5-15553e260f4b tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:00.871792 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b6c275db-90d5-41a6-92f5-15553e260f4b tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:00.947531 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a9301622-6c9f-4fb2-90e4-7b71df1a7733 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:00.964168 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a9301622-6c9f-4fb2-90e4-7b71df1a7733 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1366 microversion: 2.1 time: 0.310990 Aug 22 17:37:00.966641 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 436/871] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:00 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1366 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:00.975800 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6c683622-aebe-44f3-a288-673d461b11ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:00.977466 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6c683622-aebe-44f3-a288-673d461b11ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:00.996467 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b6c275db-90d5-41a6-92f5-15553e260f4b tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:00.998676 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c683622-aebe-44f3-a288-673d461b11ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:01.000402 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c683622-aebe-44f3-a288-673d461b11ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:01.004631 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c683622-aebe-44f3-a288-673d461b11ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:01.007362 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c683622-aebe-44f3-a288-673d461b11ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:01.008274 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b6c275db-90d5-41a6-92f5-15553e260f4b tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1089 microversion: 2.1 time: 0.144470 Aug 22 17:37:01.008560 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c683622-aebe-44f3-a288-673d461b11ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:01.009139 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c683622-aebe-44f3-a288-673d461b11ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:01.019284 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 436/872] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:00 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1089 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:01.241221 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6c683622-aebe-44f3-a288-673d461b11ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:01.259062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6c683622-aebe-44f3-a288-673d461b11ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:01.259062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6c683622-aebe-44f3-a288-673d461b11ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:01.259062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6c683622-aebe-44f3-a288-673d461b11ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1742 microversion: 2.20 time: 0.289051 Aug 22 17:37:01.259786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 437/873] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:00 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1742 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:01.996433 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2c23ef07-c3a5-48f1-a70c-1cfdce5812c2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:01.997201 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2c23ef07-c3a5-48f1-a70c-1cfdce5812c2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:02.008541 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c23ef07-c3a5-48f1-a70c-1cfdce5812c2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:02.009570 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c23ef07-c3a5-48f1-a70c-1cfdce5812c2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:02.009856 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c23ef07-c3a5-48f1-a70c-1cfdce5812c2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:02.010713 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c23ef07-c3a5-48f1-a70c-1cfdce5812c2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:02.011201 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c23ef07-c3a5-48f1-a70c-1cfdce5812c2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:02.011641 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2c23ef07-c3a5-48f1-a70c-1cfdce5812c2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:02.033178 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f98561a3-8b37-4bfb-88ae-b96da95bb403 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:02.046084 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f98561a3-8b37-4bfb-88ae-b96da95bb403 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:02.093160 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f98561a3-8b37-4bfb-88ae-b96da95bb403 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:02.101479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f98561a3-8b37-4bfb-88ae-b96da95bb403 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1089 microversion: 2.1 time: 0.072674 Aug 22 17:37:02.102062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 438/874] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:02 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:37:02.172802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2c23ef07-c3a5-48f1-a70c-1cfdce5812c2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:02.181527 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2c23ef07-c3a5-48f1-a70c-1cfdce5812c2 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1366 microversion: 2.1 time: 0.189538 Aug 22 17:37:02.182120 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 437/875] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:01 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:02.284868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5d632e32-8fe6-42aa-9739-81f2654d091b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:02.285911 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5d632e32-8fe6-42aa-9739-81f2654d091b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:02.296829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5d632e32-8fe6-42aa-9739-81f2654d091b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:02.297563 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5d632e32-8fe6-42aa-9739-81f2654d091b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:02.298298 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5d632e32-8fe6-42aa-9739-81f2654d091b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:02.300075 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5d632e32-8fe6-42aa-9739-81f2654d091b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:02.301225 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5d632e32-8fe6-42aa-9739-81f2654d091b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:02.302440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5d632e32-8fe6-42aa-9739-81f2654d091b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:02.461558 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5d632e32-8fe6-42aa-9739-81f2654d091b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:02.472039 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5d632e32-8fe6-42aa-9739-81f2654d091b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:02.473642 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5d632e32-8fe6-42aa-9739-81f2654d091b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:02.474910 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5d632e32-8fe6-42aa-9739-81f2654d091b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1742 microversion: 2.20 time: 0.197606 Aug 22 17:37:02.475548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 439/876] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:02 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1742 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:02.938847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-ca957ede-ce1e-4ef9-916c-00ccb1d6c12b req-8a901946-b30c-497c-b70a-92f7022d0557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a67bb4-4540-4e14-a7bc-74bf8ca080da", "name": "network-vif-plugged", "status": "completed", "tag": "c93f66cf-3a0a-41e2-a4a1-03d394f2cce2"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:37:02.949830 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-ca957ede-ce1e-4ef9-916c-00ccb1d6c12b req-8a901946-b30c-497c-b70a-92f7022d0557 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:02.950306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-ca957ede-ce1e-4ef9-916c-00ccb1d6c12b req-8a901946-b30c-497c-b70a-92f7022d0557 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:02.950885 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-ca957ede-ce1e-4ef9-916c-00ccb1d6c12b req-8a901946-b30c-497c-b70a-92f7022d0557 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:02.963545 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-ca957ede-ce1e-4ef9-916c-00ccb1d6c12b req-8a901946-b30c-497c-b70a-92f7022d0557 service nova] Creating event network-vif-plugged:c93f66cf-3a0a-41e2-a4a1-03d394f2cce2 for instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da on hv-cinder-85394 Aug 22 17:37:02.968916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-ca957ede-ce1e-4ef9-916c-00ccb1d6c12b req-8a901946-b30c-497c-b70a-92f7022d0557 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033990 Aug 22 17:37:02.973325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 438/877] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:37:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:37:03.126085 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-257d75f8-e34f-419a-b50c-c6b60a02e1cd tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:03.126846 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-257d75f8-e34f-419a-b50c-c6b60a02e1cd tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:03.133928 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-257d75f8-e34f-419a-b50c-c6b60a02e1cd tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:03.134441 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-257d75f8-e34f-419a-b50c-c6b60a02e1cd tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:03.134894 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-257d75f8-e34f-419a-b50c-c6b60a02e1cd tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:03.135597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-257d75f8-e34f-419a-b50c-c6b60a02e1cd tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:03.136050 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-257d75f8-e34f-419a-b50c-c6b60a02e1cd tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:03.136474 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-257d75f8-e34f-419a-b50c-c6b60a02e1cd tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:03.207169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-257d75f8-e34f-419a-b50c-c6b60a02e1cd tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:03.209281 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-48957437-e349-43f8-8fe0-c73d24b28dc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:03.210548 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-48957437-e349-43f8-8fe0-c73d24b28dc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:03.217397 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-257d75f8-e34f-419a-b50c-c6b60a02e1cd tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1131 microversion: 2.1 time: 0.097353 Aug 22 17:37:03.218006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 440/878] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:03 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1131 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:37:03.218659 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-48957437-e349-43f8-8fe0-c73d24b28dc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:03.219328 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-48957437-e349-43f8-8fe0-c73d24b28dc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:03.220020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-48957437-e349-43f8-8fe0-c73d24b28dc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:03.221492 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-48957437-e349-43f8-8fe0-c73d24b28dc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:03.222040 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-48957437-e349-43f8-8fe0-c73d24b28dc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:03.222662 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-48957437-e349-43f8-8fe0-c73d24b28dc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:03.393672 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-48957437-e349-43f8-8fe0-c73d24b28dc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:03.401888 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-48957437-e349-43f8-8fe0-c73d24b28dc6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1366 microversion: 2.1 time: 0.201008 Aug 22 17:37:03.402472 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 439/879] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:03 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:03.498622 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-72239a76-03e5-4b8d-9f6b-4b45a6b05e72 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:03.499186 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-72239a76-03e5-4b8d-9f6b-4b45a6b05e72 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:03.506231 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72239a76-03e5-4b8d-9f6b-4b45a6b05e72 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:03.506758 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72239a76-03e5-4b8d-9f6b-4b45a6b05e72 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:03.507203 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72239a76-03e5-4b8d-9f6b-4b45a6b05e72 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:03.507914 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72239a76-03e5-4b8d-9f6b-4b45a6b05e72 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:03.508557 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72239a76-03e5-4b8d-9f6b-4b45a6b05e72 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:03.508994 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-72239a76-03e5-4b8d-9f6b-4b45a6b05e72 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:03.683702 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-72239a76-03e5-4b8d-9f6b-4b45a6b05e72 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:03.693406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-72239a76-03e5-4b8d-9f6b-4b45a6b05e72 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:03.696351 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-72239a76-03e5-4b8d-9f6b-4b45a6b05e72 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:03.696351 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-72239a76-03e5-4b8d-9f6b-4b45a6b05e72 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1742 microversion: 2.20 time: 0.201615 Aug 22 17:37:03.696674 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 441/880] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:03 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1742 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:04.240813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e779156b-b8fe-4a09-9bed-353a7c8c12eb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:04.241422 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e779156b-b8fe-4a09-9bed-353a7c8c12eb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:04.248906 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e779156b-b8fe-4a09-9bed-353a7c8c12eb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:04.249408 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e779156b-b8fe-4a09-9bed-353a7c8c12eb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:04.249851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e779156b-b8fe-4a09-9bed-353a7c8c12eb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:04.250608 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e779156b-b8fe-4a09-9bed-353a7c8c12eb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:04.251067 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e779156b-b8fe-4a09-9bed-353a7c8c12eb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:04.251498 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e779156b-b8fe-4a09-9bed-353a7c8c12eb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:04.320802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e779156b-b8fe-4a09-9bed-353a7c8c12eb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:04.329911 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e779156b-b8fe-4a09-9bed-353a7c8c12eb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1187 microversion: 2.1 time: 0.095041 Aug 22 17:37:04.331647 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 440/881] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:04 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1187 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:04.424838 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-47bd6720-c1b2-4b2e-8be5-2f9bcbb5c26e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:04.425940 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-47bd6720-c1b2-4b2e-8be5-2f9bcbb5c26e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:04.433060 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-47bd6720-c1b2-4b2e-8be5-2f9bcbb5c26e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:04.436110 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-47bd6720-c1b2-4b2e-8be5-2f9bcbb5c26e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:04.436110 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-47bd6720-c1b2-4b2e-8be5-2f9bcbb5c26e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:04.436110 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-47bd6720-c1b2-4b2e-8be5-2f9bcbb5c26e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:04.436110 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-47bd6720-c1b2-4b2e-8be5-2f9bcbb5c26e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:04.436696 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-47bd6720-c1b2-4b2e-8be5-2f9bcbb5c26e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:04.607387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-47bd6720-c1b2-4b2e-8be5-2f9bcbb5c26e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:04.621349 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-47bd6720-c1b2-4b2e-8be5-2f9bcbb5c26e tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1555 microversion: 2.1 time: 0.200553 Aug 22 17:37:04.622784 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 442/882] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:04 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1555 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:04.649931 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4326809b-3089-42e5-9d6e-1d8f23cd7011 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:04.650613 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4326809b-3089-42e5-9d6e-1d8f23cd7011 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:04.657008 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4326809b-3089-42e5-9d6e-1d8f23cd7011 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:04.657590 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4326809b-3089-42e5-9d6e-1d8f23cd7011 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:04.658120 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4326809b-3089-42e5-9d6e-1d8f23cd7011 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:04.659516 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4326809b-3089-42e5-9d6e-1d8f23cd7011 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:04.660173 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4326809b-3089-42e5-9d6e-1d8f23cd7011 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:04.660653 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4326809b-3089-42e5-9d6e-1d8f23cd7011 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:04.722762 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c465d670-e392-4ce9-9692-6134e2ff6708 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:04.723381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c465d670-e392-4ce9-9692-6134e2ff6708 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:04.729957 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c465d670-e392-4ce9-9692-6134e2ff6708 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:04.730450 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c465d670-e392-4ce9-9692-6134e2ff6708 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:04.730922 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c465d670-e392-4ce9-9692-6134e2ff6708 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:04.731676 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c465d670-e392-4ce9-9692-6134e2ff6708 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:04.732286 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c465d670-e392-4ce9-9692-6134e2ff6708 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:04.734303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c465d670-e392-4ce9-9692-6134e2ff6708 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:04.776249 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4326809b-3089-42e5-9d6e-1d8f23cd7011 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.129703 Aug 22 17:37:04.779692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 441/883] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 22 17:37:04 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/os-interface => generated 284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:37:04.932750 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c465d670-e392-4ce9-9692-6134e2ff6708 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:04.946391 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c465d670-e392-4ce9-9692-6134e2ff6708 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:04.948428 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c465d670-e392-4ce9-9692-6134e2ff6708 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:04.949855 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c465d670-e392-4ce9-9692-6134e2ff6708 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1742 microversion: 2.20 time: 0.232423 Aug 22 17:37:04.950927 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 443/884] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:04 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1742 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:05.371970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4d8e389a-3690-49a9-9505-0f96e5f04740 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:05.373025 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4d8e389a-3690-49a9-9505-0f96e5f04740 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:05.382717 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d8e389a-3690-49a9-9505-0f96e5f04740 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:05.385753 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d8e389a-3690-49a9-9505-0f96e5f04740 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:05.385753 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d8e389a-3690-49a9-9505-0f96e5f04740 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:05.385753 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d8e389a-3690-49a9-9505-0f96e5f04740 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:05.385753 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d8e389a-3690-49a9-9505-0f96e5f04740 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:05.386575 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d8e389a-3690-49a9-9505-0f96e5f04740 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:05.497033 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4d8e389a-3690-49a9-9505-0f96e5f04740 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:05.506722 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4d8e389a-3690-49a9-9505-0f96e5f04740 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1205 microversion: 2.1 time: 0.145926 Aug 22 17:37:05.507931 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 442/885] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:05 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1205 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:37:05.978002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c57f93a3-1d86-41fd-b036-3c0ab001976f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:05.979366 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c57f93a3-1d86-41fd-b036-3c0ab001976f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:05.990913 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c57f93a3-1d86-41fd-b036-3c0ab001976f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:05.991751 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c57f93a3-1d86-41fd-b036-3c0ab001976f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:05.993048 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c57f93a3-1d86-41fd-b036-3c0ab001976f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:05.993858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c57f93a3-1d86-41fd-b036-3c0ab001976f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:05.994411 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c57f93a3-1d86-41fd-b036-3c0ab001976f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:05.994933 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c57f93a3-1d86-41fd-b036-3c0ab001976f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:06.223392 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c57f93a3-1d86-41fd-b036-3c0ab001976f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:06.234805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c57f93a3-1d86-41fd-b036-3c0ab001976f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:06.238910 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c57f93a3-1d86-41fd-b036-3c0ab001976f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:06.240708 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c57f93a3-1d86-41fd-b036-3c0ab001976f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1737 microversion: 2.20 time: 0.269987 Aug 22 17:37:06.241703 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 444/886] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:05 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1737 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:06.534232 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-775655cf-1575-4b83-8738-eda8f55f5f4b tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:06.536449 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-775655cf-1575-4b83-8738-eda8f55f5f4b tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:06.548661 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-775655cf-1575-4b83-8738-eda8f55f5f4b tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:06.550569 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-775655cf-1575-4b83-8738-eda8f55f5f4b tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:06.551579 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-775655cf-1575-4b83-8738-eda8f55f5f4b tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:06.553119 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-775655cf-1575-4b83-8738-eda8f55f5f4b tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:06.553949 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-775655cf-1575-4b83-8738-eda8f55f5f4b tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:06.554852 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-775655cf-1575-4b83-8738-eda8f55f5f4b tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:07.271394 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-09f33ecc-311f-4d9c-85d1-42e350a99d44 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:07.273072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-09f33ecc-311f-4d9c-85d1-42e350a99d44 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:07.298071 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09f33ecc-311f-4d9c-85d1-42e350a99d44 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:07.299806 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09f33ecc-311f-4d9c-85d1-42e350a99d44 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:07.300902 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09f33ecc-311f-4d9c-85d1-42e350a99d44 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:07.303911 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09f33ecc-311f-4d9c-85d1-42e350a99d44 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:07.305848 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09f33ecc-311f-4d9c-85d1-42e350a99d44 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:07.306948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09f33ecc-311f-4d9c-85d1-42e350a99d44 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:07.470041 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-775655cf-1575-4b83-8738-eda8f55f5f4b tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:07.476047 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=100 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:37:07.498311 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-775655cf-1575-4b83-8738-eda8f55f5f4b tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1261 microversion: 2.1 time: 0.963182 Aug 22 17:37:07.499193 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 443/887] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:06 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1261 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:07.619566 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-09f33ecc-311f-4d9c-85d1-42e350a99d44 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:07.667890 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-09f33ecc-311f-4d9c-85d1-42e350a99d44 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:07.671048 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-09f33ecc-311f-4d9c-85d1-42e350a99d44 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:07.674872 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-09f33ecc-311f-4d9c-85d1-42e350a99d44 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1737 microversion: 2.20 time: 0.408612 Aug 22 17:37:07.677796 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 445/888] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:07 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1737 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:07.739380 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-eeb76871-2e59-4164-bebf-6c3357882d20 req-06d6ae1f-f925-4910-9faa-2fe6ffa345bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "807e63ee-52a6-4bcc-bc90-d492fff06ad6", "tag": "fe1e7627-2a87-4924-873f-5bc0f6035f49"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:37:07.758759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-eeb76871-2e59-4164-bebf-6c3357882d20 req-06d6ae1f-f925-4910-9faa-2fe6ffa345bc service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:07.759288 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-eeb76871-2e59-4164-bebf-6c3357882d20 req-06d6ae1f-f925-4910-9faa-2fe6ffa345bc service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:07.759743 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-eeb76871-2e59-4164-bebf-6c3357882d20 req-06d6ae1f-f925-4910-9faa-2fe6ffa345bc service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:07.777293 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-eeb76871-2e59-4164-bebf-6c3357882d20 req-06d6ae1f-f925-4910-9faa-2fe6ffa345bc service nova] Creating event network-changed:fe1e7627-2a87-4924-873f-5bc0f6035f49 for instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 on hv-cinder-85394 Aug 22 17:37:07.783555 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-eeb76871-2e59-4164-bebf-6c3357882d20 req-06d6ae1f-f925-4910-9faa-2fe6ffa345bc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049005 Aug 22 17:37:07.784509 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 444/889] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:37:08.548560 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4dd2970d-e0e2-4727-a3a2-71ef2016d696 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:08.559347 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4dd2970d-e0e2-4727-a3a2-71ef2016d696 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:08.595206 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4dd2970d-e0e2-4727-a3a2-71ef2016d696 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:08.600062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4dd2970d-e0e2-4727-a3a2-71ef2016d696 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:08.604981 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4dd2970d-e0e2-4727-a3a2-71ef2016d696 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:08.606916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4dd2970d-e0e2-4727-a3a2-71ef2016d696 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:08.607842 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4dd2970d-e0e2-4727-a3a2-71ef2016d696 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:08.608612 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4dd2970d-e0e2-4727-a3a2-71ef2016d696 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:08.701226 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6534edcd-0512-439d-bcb3-587c77016e4f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:08.702509 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6534edcd-0512-439d-bcb3-587c77016e4f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:08.714466 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6534edcd-0512-439d-bcb3-587c77016e4f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:08.715001 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6534edcd-0512-439d-bcb3-587c77016e4f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:08.715447 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6534edcd-0512-439d-bcb3-587c77016e4f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:08.716195 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6534edcd-0512-439d-bcb3-587c77016e4f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:08.716664 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6534edcd-0512-439d-bcb3-587c77016e4f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:08.717097 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6534edcd-0512-439d-bcb3-587c77016e4f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:09.071173 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6534edcd-0512-439d-bcb3-587c77016e4f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:09.082346 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6534edcd-0512-439d-bcb3-587c77016e4f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:09.084641 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6534edcd-0512-439d-bcb3-587c77016e4f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:09.086200 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6534edcd-0512-439d-bcb3-587c77016e4f tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1737 microversion: 2.20 time: 0.389799 Aug 22 17:37:09.102264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 445/890] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:08 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1737 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:09.358401 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4dd2970d-e0e2-4727-a3a2-71ef2016d696 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:09.382909 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4dd2970d-e0e2-4727-a3a2-71ef2016d696 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1261 microversion: 2.1 time: 0.838711 Aug 22 17:37:09.383585 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 446/891] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:08 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1261 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:09.847922 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-8776c184-fee6-4780-8f05-a145676898b6 req-e1c5a8de-51f8-4959-9c15-680a773b670b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c5d826-b574-453f-9bb2-d7d6f8b6bb15", "tag": "abca211f-f649-45c4-8d69-21154b866c5b"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:37:09.860892 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-8776c184-fee6-4780-8f05-a145676898b6 req-e1c5a8de-51f8-4959-9c15-680a773b670b service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:09.862012 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-8776c184-fee6-4780-8f05-a145676898b6 req-e1c5a8de-51f8-4959-9c15-680a773b670b service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:09.862578 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-8776c184-fee6-4780-8f05-a145676898b6 req-e1c5a8de-51f8-4959-9c15-680a773b670b service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:09.881128 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-8776c184-fee6-4780-8f05-a145676898b6 req-e1c5a8de-51f8-4959-9c15-680a773b670b service nova] Creating event network-changed:abca211f-f649-45c4-8d69-21154b866c5b for instance 08c5d826-b574-453f-9bb2-d7d6f8b6bb15 on hv-cinder-85394 Aug 22 17:37:09.887615 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-8776c184-fee6-4780-8f05-a145676898b6 req-e1c5a8de-51f8-4959-9c15-680a773b670b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046997 Aug 22 17:37:09.888337 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 446/892] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:37:10.109796 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-13d36111-ccfc-4c9f-8978-370acd4735e3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:10.110357 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-13d36111-ccfc-4c9f-8978-370acd4735e3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:10.117339 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-13d36111-ccfc-4c9f-8978-370acd4735e3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:10.117812 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-13d36111-ccfc-4c9f-8978-370acd4735e3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:10.118288 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-13d36111-ccfc-4c9f-8978-370acd4735e3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:10.119035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-13d36111-ccfc-4c9f-8978-370acd4735e3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:10.119518 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-13d36111-ccfc-4c9f-8978-370acd4735e3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:10.119941 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-13d36111-ccfc-4c9f-8978-370acd4735e3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:10.276388 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-13d36111-ccfc-4c9f-8978-370acd4735e3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:10.295504 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-13d36111-ccfc-4c9f-8978-370acd4735e3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:10.298114 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-13d36111-ccfc-4c9f-8978-370acd4735e3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:10.300794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-13d36111-ccfc-4c9f-8978-370acd4735e3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1737 microversion: 2.20 time: 0.194745 Aug 22 17:37:10.301735 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 447/893] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:10 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:10.405773 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:37:10.411003 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-af055af4-e52c-4e77-ab52-f30f9979410c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:10.415668 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-af055af4-e52c-4e77-ab52-f30f9979410c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:10.418249 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-af055af4-e52c-4e77-ab52-f30f9979410c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:10.418786 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-af055af4-e52c-4e77-ab52-f30f9979410c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:10.419196 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-af055af4-e52c-4e77-ab52-f30f9979410c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:10.419882 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-af055af4-e52c-4e77-ab52-f30f9979410c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:10.420329 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-af055af4-e52c-4e77-ab52-f30f9979410c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:10.420749 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-af055af4-e52c-4e77-ab52-f30f9979410c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:10.602723 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-af055af4-e52c-4e77-ab52-f30f9979410c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:10.620654 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-af055af4-e52c-4e77-ab52-f30f9979410c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1261 microversion: 2.1 time: 0.214634 Aug 22 17:37:10.636697 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 447/894] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:10 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1261 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:37:11.328119 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b267b313-2d7f-439b-8189-cf825245e9f5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:11.329839 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b267b313-2d7f-439b-8189-cf825245e9f5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:11.341427 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b267b313-2d7f-439b-8189-cf825245e9f5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:11.342680 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b267b313-2d7f-439b-8189-cf825245e9f5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:11.343524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b267b313-2d7f-439b-8189-cf825245e9f5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:11.344761 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b267b313-2d7f-439b-8189-cf825245e9f5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:11.346178 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b267b313-2d7f-439b-8189-cf825245e9f5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:11.346974 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b267b313-2d7f-439b-8189-cf825245e9f5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:11.606409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b267b313-2d7f-439b-8189-cf825245e9f5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:11.623225 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b267b313-2d7f-439b-8189-cf825245e9f5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:11.624848 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b267b313-2d7f-439b-8189-cf825245e9f5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:11.626140 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b267b313-2d7f-439b-8189-cf825245e9f5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1737 microversion: 2.20 time: 0.304362 Aug 22 17:37:11.639069 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 448/895] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:11 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1737 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:11.663160 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-aaddd35f-dc1e-44f0-a9e3-9c5ec205ac07 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:11.664602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-aaddd35f-dc1e-44f0-a9e3-9c5ec205ac07 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:11.671787 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=8 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:37:11.674944 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aaddd35f-dc1e-44f0-a9e3-9c5ec205ac07 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:11.676296 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aaddd35f-dc1e-44f0-a9e3-9c5ec205ac07 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:11.676986 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aaddd35f-dc1e-44f0-a9e3-9c5ec205ac07 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:11.678090 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aaddd35f-dc1e-44f0-a9e3-9c5ec205ac07 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:11.678571 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aaddd35f-dc1e-44f0-a9e3-9c5ec205ac07 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:11.679294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aaddd35f-dc1e-44f0-a9e3-9c5ec205ac07 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:11.946866 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-aaddd35f-dc1e-44f0-a9e3-9c5ec205ac07 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:11.958152 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-aaddd35f-dc1e-44f0-a9e3-9c5ec205ac07 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1261 microversion: 2.1 time: 0.299326 Aug 22 17:37:11.960358 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 448/896] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:11 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1261 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:12.650429 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8dde8079-a605-4ba1-b4e7-089dffe26393 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:12.651146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8dde8079-a605-4ba1-b4e7-089dffe26393 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:12.659599 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:37:12.660377 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8dde8079-a605-4ba1-b4e7-089dffe26393 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:12.660982 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8dde8079-a605-4ba1-b4e7-089dffe26393 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:12.661507 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8dde8079-a605-4ba1-b4e7-089dffe26393 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:12.662319 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8dde8079-a605-4ba1-b4e7-089dffe26393 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:12.662938 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8dde8079-a605-4ba1-b4e7-089dffe26393 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:12.663413 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8dde8079-a605-4ba1-b4e7-089dffe26393 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:12.859840 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8dde8079-a605-4ba1-b4e7-089dffe26393 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:12.883843 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8dde8079-a605-4ba1-b4e7-089dffe26393 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:12.886100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8dde8079-a605-4ba1-b4e7-089dffe26393 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:12.887085 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8dde8079-a605-4ba1-b4e7-089dffe26393 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1737 microversion: 2.20 time: 0.240854 Aug 22 17:37:12.888071 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 449/897] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:12 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1737 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:12.994191 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-25a63764-306e-4335-9349-1dac86ee57a6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:12.995481 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-25a63764-306e-4335-9349-1dac86ee57a6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:13.006552 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-25a63764-306e-4335-9349-1dac86ee57a6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:13.007359 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-25a63764-306e-4335-9349-1dac86ee57a6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:13.008058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-25a63764-306e-4335-9349-1dac86ee57a6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:13.009200 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-25a63764-306e-4335-9349-1dac86ee57a6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:13.009927 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-25a63764-306e-4335-9349-1dac86ee57a6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:13.010910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-25a63764-306e-4335-9349-1dac86ee57a6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:13.234547 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-25a63764-306e-4335-9349-1dac86ee57a6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:13.257729 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-25a63764-306e-4335-9349-1dac86ee57a6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1261 microversion: 2.1 time: 0.271005 Aug 22 17:37:13.259052 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 449/898] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:12 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1261 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:37:13.926602 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c95c6fcf-8ec5-425f-8253-617b79283212 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:13.927346 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c95c6fcf-8ec5-425f-8253-617b79283212 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:13.935703 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c95c6fcf-8ec5-425f-8253-617b79283212 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:13.936220 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c95c6fcf-8ec5-425f-8253-617b79283212 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:13.936683 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c95c6fcf-8ec5-425f-8253-617b79283212 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:13.937446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c95c6fcf-8ec5-425f-8253-617b79283212 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:13.937961 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c95c6fcf-8ec5-425f-8253-617b79283212 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:13.938399 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c95c6fcf-8ec5-425f-8253-617b79283212 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:14.108884 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c95c6fcf-8ec5-425f-8253-617b79283212 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:14.117365 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c95c6fcf-8ec5-425f-8253-617b79283212 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:14.118881 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c95c6fcf-8ec5-425f-8253-617b79283212 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:14.120054 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c95c6fcf-8ec5-425f-8253-617b79283212 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1737 microversion: 2.20 time: 0.198483 Aug 22 17:37:14.120615 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 450/899] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:13 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:14.280215 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f829f6f6-169f-48d2-83e0-09dcda4ad286 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:14.280778 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f829f6f6-169f-48d2-83e0-09dcda4ad286 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:14.288642 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f829f6f6-169f-48d2-83e0-09dcda4ad286 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:14.289138 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f829f6f6-169f-48d2-83e0-09dcda4ad286 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:14.289581 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f829f6f6-169f-48d2-83e0-09dcda4ad286 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:14.290287 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f829f6f6-169f-48d2-83e0-09dcda4ad286 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:14.290775 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f829f6f6-169f-48d2-83e0-09dcda4ad286 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:14.291200 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f829f6f6-169f-48d2-83e0-09dcda4ad286 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:14.454348 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f829f6f6-169f-48d2-83e0-09dcda4ad286 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:14.466761 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f829f6f6-169f-48d2-83e0-09dcda4ad286 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1261 microversion: 2.1 time: 0.190616 Aug 22 17:37:14.468049 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 450/900] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:14 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1261 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:37:15.160036 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b54f6e79-d0fc-4add-9dcd-f400341e0722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:15.163379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b54f6e79-d0fc-4add-9dcd-f400341e0722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:15.172438 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b54f6e79-d0fc-4add-9dcd-f400341e0722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:15.173335 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b54f6e79-d0fc-4add-9dcd-f400341e0722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:15.174168 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b54f6e79-d0fc-4add-9dcd-f400341e0722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:15.175110 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b54f6e79-d0fc-4add-9dcd-f400341e0722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:15.181359 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b54f6e79-d0fc-4add-9dcd-f400341e0722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:15.181359 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b54f6e79-d0fc-4add-9dcd-f400341e0722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:15.423342 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b54f6e79-d0fc-4add-9dcd-f400341e0722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:15.442675 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b54f6e79-d0fc-4add-9dcd-f400341e0722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:15.446750 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b54f6e79-d0fc-4add-9dcd-f400341e0722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:15.449208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b54f6e79-d0fc-4add-9dcd-f400341e0722 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1737 microversion: 2.20 time: 0.302474 Aug 22 17:37:15.450439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 451/901] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:15 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1737 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:15.498010 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c1fa70fd-a686-4af2-b6a1-3c466e9e1dea tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:15.500251 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c1fa70fd-a686-4af2-b6a1-3c466e9e1dea tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:15.512648 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1fa70fd-a686-4af2-b6a1-3c466e9e1dea tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:15.513467 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1fa70fd-a686-4af2-b6a1-3c466e9e1dea tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:15.513915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1fa70fd-a686-4af2-b6a1-3c466e9e1dea tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:15.514687 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1fa70fd-a686-4af2-b6a1-3c466e9e1dea tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:15.515346 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1fa70fd-a686-4af2-b6a1-3c466e9e1dea tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:15.515969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1fa70fd-a686-4af2-b6a1-3c466e9e1dea tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:15.756033 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c1fa70fd-a686-4af2-b6a1-3c466e9e1dea tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:15.772775 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c1fa70fd-a686-4af2-b6a1-3c466e9e1dea tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1261 microversion: 2.1 time: 0.281097 Aug 22 17:37:15.779804 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 451/902] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:15 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1261 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:16.480514 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a8179336-04fa-49b1-a27a-f04d8ffed125 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:16.481632 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a8179336-04fa-49b1-a27a-f04d8ffed125 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:16.500409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8179336-04fa-49b1-a27a-f04d8ffed125 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:16.501210 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8179336-04fa-49b1-a27a-f04d8ffed125 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:16.502384 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8179336-04fa-49b1-a27a-f04d8ffed125 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:16.503153 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8179336-04fa-49b1-a27a-f04d8ffed125 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:16.503770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8179336-04fa-49b1-a27a-f04d8ffed125 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:16.504410 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a8179336-04fa-49b1-a27a-f04d8ffed125 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:16.712017 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a8179336-04fa-49b1-a27a-f04d8ffed125 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:16.722073 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a8179336-04fa-49b1-a27a-f04d8ffed125 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:16.723654 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a8179336-04fa-49b1-a27a-f04d8ffed125 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:16.724866 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a8179336-04fa-49b1-a27a-f04d8ffed125 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1737 microversion: 2.20 time: 0.254500 Aug 22 17:37:16.725731 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 452/903] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:16 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1737 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:16.797561 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-adda4487-ac9f-45ea-ba20-36fd7b985420 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:16.798780 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-adda4487-ac9f-45ea-ba20-36fd7b985420 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:16.815166 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-adda4487-ac9f-45ea-ba20-36fd7b985420 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:16.816088 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-adda4487-ac9f-45ea-ba20-36fd7b985420 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:16.817134 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-adda4487-ac9f-45ea-ba20-36fd7b985420 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:16.818107 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-adda4487-ac9f-45ea-ba20-36fd7b985420 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:16.818848 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-adda4487-ac9f-45ea-ba20-36fd7b985420 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:16.820120 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-adda4487-ac9f-45ea-ba20-36fd7b985420 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:17.046973 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-adda4487-ac9f-45ea-ba20-36fd7b985420 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:17.060284 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-adda4487-ac9f-45ea-ba20-36fd7b985420 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1261 microversion: 2.1 time: 0.269129 Aug 22 17:37:17.060881 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 452/904] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:16 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1261 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:17.752654 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-18898e96-4e10-4fb9-bce9-5078012730db tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:17.755349 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-18898e96-4e10-4fb9-bce9-5078012730db tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:17.766795 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-18898e96-4e10-4fb9-bce9-5078012730db tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:17.768643 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-18898e96-4e10-4fb9-bce9-5078012730db tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:17.769648 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-18898e96-4e10-4fb9-bce9-5078012730db tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:17.771205 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-18898e96-4e10-4fb9-bce9-5078012730db tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:17.772160 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-18898e96-4e10-4fb9-bce9-5078012730db tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:17.772899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-18898e96-4e10-4fb9-bce9-5078012730db tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:17.780971 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=100 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:37:18.048481 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-18898e96-4e10-4fb9-bce9-5078012730db tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:18.064537 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-18898e96-4e10-4fb9-bce9-5078012730db tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:18.068141 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-18898e96-4e10-4fb9-bce9-5078012730db tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:18.069764 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-18898e96-4e10-4fb9-bce9-5078012730db tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1737 microversion: 2.20 time: 0.324383 Aug 22 17:37:18.073454 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 453/905] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:17 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1737 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:18.089168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-930d0cd6-c6c1-4ba3-ac26-d971204e6ecb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:18.092347 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-930d0cd6-c6c1-4ba3-ac26-d971204e6ecb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:18.099710 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-930d0cd6-c6c1-4ba3-ac26-d971204e6ecb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:18.100198 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-930d0cd6-c6c1-4ba3-ac26-d971204e6ecb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:18.100713 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-930d0cd6-c6c1-4ba3-ac26-d971204e6ecb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:18.102469 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-930d0cd6-c6c1-4ba3-ac26-d971204e6ecb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:18.103177 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-930d0cd6-c6c1-4ba3-ac26-d971204e6ecb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:18.103757 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-930d0cd6-c6c1-4ba3-ac26-d971204e6ecb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:18.273558 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-930d0cd6-c6c1-4ba3-ac26-d971204e6ecb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:18.286539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-930d0cd6-c6c1-4ba3-ac26-d971204e6ecb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1261 microversion: 2.1 time: 0.207335 Aug 22 17:37:18.287879 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 453/906] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:18 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1261 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:19.098780 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-28ebd64f-4dae-427b-b28e-2de742484435 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:19.099815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-28ebd64f-4dae-427b-b28e-2de742484435 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:19.107474 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-28ebd64f-4dae-427b-b28e-2de742484435 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:19.108180 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-28ebd64f-4dae-427b-b28e-2de742484435 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:19.108760 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-28ebd64f-4dae-427b-b28e-2de742484435 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:19.109708 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-28ebd64f-4dae-427b-b28e-2de742484435 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:19.110344 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-28ebd64f-4dae-427b-b28e-2de742484435 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:19.111700 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-28ebd64f-4dae-427b-b28e-2de742484435 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:19.294021 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-28ebd64f-4dae-427b-b28e-2de742484435 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:19.304400 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-28ebd64f-4dae-427b-b28e-2de742484435 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:19.305971 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-28ebd64f-4dae-427b-b28e-2de742484435 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:19.307241 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-28ebd64f-4dae-427b-b28e-2de742484435 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1737 microversion: 2.20 time: 0.214959 Aug 22 17:37:19.312767 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1d347252-cb49-43ec-9236-aec05bac022d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:19.315266 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1d347252-cb49-43ec-9236-aec05bac022d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:19.315492 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 454/907] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:19 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:19.324217 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1d347252-cb49-43ec-9236-aec05bac022d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:19.324907 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1d347252-cb49-43ec-9236-aec05bac022d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:19.325656 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1d347252-cb49-43ec-9236-aec05bac022d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:19.326800 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1d347252-cb49-43ec-9236-aec05bac022d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:19.327424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1d347252-cb49-43ec-9236-aec05bac022d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:19.328081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1d347252-cb49-43ec-9236-aec05bac022d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:19.488699 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1d347252-cb49-43ec-9236-aec05bac022d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:19.497052 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1d347252-cb49-43ec-9236-aec05bac022d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1261 microversion: 2.1 time: 0.189631 Aug 22 17:37:19.497641 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 454/908] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:19 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1261 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:20.334846 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-89f5968c-014e-49e7-8cfa-daf541d6e014 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:20.335798 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-89f5968c-014e-49e7-8cfa-daf541d6e014 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:20.343386 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89f5968c-014e-49e7-8cfa-daf541d6e014 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:20.343884 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89f5968c-014e-49e7-8cfa-daf541d6e014 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:20.344327 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89f5968c-014e-49e7-8cfa-daf541d6e014 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:20.345034 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89f5968c-014e-49e7-8cfa-daf541d6e014 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:20.345924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89f5968c-014e-49e7-8cfa-daf541d6e014 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:20.346632 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-89f5968c-014e-49e7-8cfa-daf541d6e014 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:20.511256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-89f5968c-014e-49e7-8cfa-daf541d6e014 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:20.520776 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-441e767f-617b-4ef2-b51e-7ddc5377dea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:20.521745 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-441e767f-617b-4ef2-b51e-7ddc5377dea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:20.522081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-89f5968c-014e-49e7-8cfa-daf541d6e014 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:20.524001 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-89f5968c-014e-49e7-8cfa-daf541d6e014 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:20.525563 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-89f5968c-014e-49e7-8cfa-daf541d6e014 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1719 microversion: 2.20 time: 0.195829 Aug 22 17:37:20.526274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 455/909] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:20 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1719 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:20.528200 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-441e767f-617b-4ef2-b51e-7ddc5377dea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:20.528691 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-441e767f-617b-4ef2-b51e-7ddc5377dea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:20.529122 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-441e767f-617b-4ef2-b51e-7ddc5377dea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:20.530021 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-441e767f-617b-4ef2-b51e-7ddc5377dea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:20.530756 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-441e767f-617b-4ef2-b51e-7ddc5377dea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:20.531447 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-441e767f-617b-4ef2-b51e-7ddc5377dea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:20.653264 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-8f493858-90f6-4505-b7f4-def6c214585b req-036dea77-2b3d-4abd-8bbb-b95d45b47347 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c5d826-b574-453f-9bb2-d7d6f8b6bb15", "name": "network-vif-plugged", "status": "completed", "tag": "abca211f-f649-45c4-8d69-21154b866c5b"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:37:20.671622 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-8f493858-90f6-4505-b7f4-def6c214585b req-036dea77-2b3d-4abd-8bbb-b95d45b47347 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:20.672688 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-8f493858-90f6-4505-b7f4-def6c214585b req-036dea77-2b3d-4abd-8bbb-b95d45b47347 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:20.673627 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-8f493858-90f6-4505-b7f4-def6c214585b req-036dea77-2b3d-4abd-8bbb-b95d45b47347 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:20.694952 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-8f493858-90f6-4505-b7f4-def6c214585b req-036dea77-2b3d-4abd-8bbb-b95d45b47347 service nova] Creating event network-vif-plugged:abca211f-f649-45c4-8d69-21154b866c5b for instance 08c5d826-b574-453f-9bb2-d7d6f8b6bb15 on hv-cinder-85394 Aug 22 17:37:20.704511 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-8f493858-90f6-4505-b7f4-def6c214585b req-036dea77-2b3d-4abd-8bbb-b95d45b47347 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061391 Aug 22 17:37:20.706283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 456/910] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:37:20.742112 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-441e767f-617b-4ef2-b51e-7ddc5377dea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:20.759423 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-441e767f-617b-4ef2-b51e-7ddc5377dea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1261 microversion: 2.1 time: 0.243606 Aug 22 17:37:20.760441 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 455/911] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:20 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1261 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:37:21.574892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-049fec40-ccda-41ab-9ba2-98d4a8d001d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:21.575812 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-049fec40-ccda-41ab-9ba2-98d4a8d001d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:21.585368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-049fec40-ccda-41ab-9ba2-98d4a8d001d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:21.585851 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-049fec40-ccda-41ab-9ba2-98d4a8d001d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:21.586285 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-049fec40-ccda-41ab-9ba2-98d4a8d001d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:21.587032 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-049fec40-ccda-41ab-9ba2-98d4a8d001d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:21.587479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-049fec40-ccda-41ab-9ba2-98d4a8d001d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:21.587932 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-049fec40-ccda-41ab-9ba2-98d4a8d001d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:21.739865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-049fec40-ccda-41ab-9ba2-98d4a8d001d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:21.749096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-049fec40-ccda-41ab-9ba2-98d4a8d001d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:21.750809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-049fec40-ccda-41ab-9ba2-98d4a8d001d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:21.752578 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-049fec40-ccda-41ab-9ba2-98d4a8d001d7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1719 microversion: 2.20 time: 0.185176 Aug 22 17:37:21.753338 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 457/912] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:21 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1719 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:21.783274 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-409d9b99-6738-4351-b38f-9407508147d5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:21.783952 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-409d9b99-6738-4351-b38f-9407508147d5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:21.791698 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-409d9b99-6738-4351-b38f-9407508147d5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:21.792188 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-409d9b99-6738-4351-b38f-9407508147d5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:21.792624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-409d9b99-6738-4351-b38f-9407508147d5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:21.793338 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-409d9b99-6738-4351-b38f-9407508147d5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:21.793784 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-409d9b99-6738-4351-b38f-9407508147d5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:21.794497 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-409d9b99-6738-4351-b38f-9407508147d5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:21.944128 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-409d9b99-6738-4351-b38f-9407508147d5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:21.952692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-409d9b99-6738-4351-b38f-9407508147d5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1261 microversion: 2.1 time: 0.173566 Aug 22 17:37:21.953279 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 456/913] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:21 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1261 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:22.721490 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-ba8b9cfe-b5e7-4f86-ae08-29d7e8a5f511 req-f4cc5447-54a8-4966-a9b6-0dd6abc7d919 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a67bb4-4540-4e14-a7bc-74bf8ca080da", "name": "network-vif-unplugged", "status": "completed", "tag": "c93f66cf-3a0a-41e2-a4a1-03d394f2cce2"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:37:22.731605 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-ba8b9cfe-b5e7-4f86-ae08-29d7e8a5f511 req-f4cc5447-54a8-4966-a9b6-0dd6abc7d919 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:22.732120 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-ba8b9cfe-b5e7-4f86-ae08-29d7e8a5f511 req-f4cc5447-54a8-4966-a9b6-0dd6abc7d919 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:22.732557 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-ba8b9cfe-b5e7-4f86-ae08-29d7e8a5f511 req-f4cc5447-54a8-4966-a9b6-0dd6abc7d919 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:22.777563 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4a88cfe5-fd3a-430f-8956-bfcccc6f25ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:22.778189 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4a88cfe5-fd3a-430f-8956-bfcccc6f25ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:22.785487 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4a88cfe5-fd3a-430f-8956-bfcccc6f25ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:22.786214 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4a88cfe5-fd3a-430f-8956-bfcccc6f25ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:22.786403 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4a88cfe5-fd3a-430f-8956-bfcccc6f25ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:22.787180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4a88cfe5-fd3a-430f-8956-bfcccc6f25ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:22.787641 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4a88cfe5-fd3a-430f-8956-bfcccc6f25ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:22.788073 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4a88cfe5-fd3a-430f-8956-bfcccc6f25ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:22.902704 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-ba8b9cfe-b5e7-4f86-ae08-29d7e8a5f511 req-f4cc5447-54a8-4966-a9b6-0dd6abc7d919 service nova] Creating event network-vif-unplugged:c93f66cf-3a0a-41e2-a4a1-03d394f2cce2 for instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da on hv-cinder-85394 Aug 22 17:37:22.908273 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-ba8b9cfe-b5e7-4f86-ae08-29d7e8a5f511 req-f4cc5447-54a8-4966-a9b6-0dd6abc7d919 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.190434 Aug 22 17:37:22.908894 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 458/914] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:37:22.945226 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4a88cfe5-fd3a-430f-8956-bfcccc6f25ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:22.955720 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4a88cfe5-fd3a-430f-8956-bfcccc6f25ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:22.957651 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4a88cfe5-fd3a-430f-8956-bfcccc6f25ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:22.958964 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4a88cfe5-fd3a-430f-8956-bfcccc6f25ca tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1722 microversion: 2.20 time: 0.185447 Aug 22 17:37:22.959540 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 457/915] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:22 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:22.976458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5f102396-e19a-4fe6-bfc5-3c123ac3150d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:22.977258 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5f102396-e19a-4fe6-bfc5-3c123ac3150d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:22.983864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a8f5eeb3-4d11-4f67-aba9-9f3ebfaf3857 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a0af371-7430-4fc6-bd32-10b3479ff2ee"}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:37:22.985367 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5f102396-e19a-4fe6-bfc5-3c123ac3150d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:22.986265 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5f102396-e19a-4fe6-bfc5-3c123ac3150d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:22.987153 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5f102396-e19a-4fe6-bfc5-3c123ac3150d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:22.987621 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a8f5eeb3-4d11-4f67-aba9-9f3ebfaf3857 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:22.988119 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5f102396-e19a-4fe6-bfc5-3c123ac3150d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:22.988603 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5f102396-e19a-4fe6-bfc5-3c123ac3150d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:22.989307 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5f102396-e19a-4fe6-bfc5-3c123ac3150d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:22.994758 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a8f5eeb3-4d11-4f67-aba9-9f3ebfaf3857 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:22.996105 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a8f5eeb3-4d11-4f67-aba9-9f3ebfaf3857 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:22.996543 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a8f5eeb3-4d11-4f67-aba9-9f3ebfaf3857 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:22.997421 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a8f5eeb3-4d11-4f67-aba9-9f3ebfaf3857 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:22.997988 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a8f5eeb3-4d11-4f67-aba9-9f3ebfaf3857 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:22.998505 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a8f5eeb3-4d11-4f67-aba9-9f3ebfaf3857 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:23.161264 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5f102396-e19a-4fe6-bfc5-3c123ac3150d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:23.171260 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5f102396-e19a-4fe6-bfc5-3c123ac3150d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1261 microversion: 2.1 time: 0.200288 Aug 22 17:37:23.171983 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 459/916] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:22 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1261 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:37:24.195379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f3ffe3a8-336e-45b6-80aa-a0e34e1c68db tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:24.196387 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f3ffe3a8-336e-45b6-80aa-a0e34e1c68db tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:24.205609 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f3ffe3a8-336e-45b6-80aa-a0e34e1c68db tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:24.206143 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f3ffe3a8-336e-45b6-80aa-a0e34e1c68db tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:24.206627 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f3ffe3a8-336e-45b6-80aa-a0e34e1c68db tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:24.207529 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f3ffe3a8-336e-45b6-80aa-a0e34e1c68db tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:24.208016 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f3ffe3a8-336e-45b6-80aa-a0e34e1c68db tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:24.208447 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f3ffe3a8-336e-45b6-80aa-a0e34e1c68db tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:24.395742 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f3ffe3a8-336e-45b6-80aa-a0e34e1c68db tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:24.404416 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f3ffe3a8-336e-45b6-80aa-a0e34e1c68db tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1261 microversion: 2.1 time: 0.215301 Aug 22 17:37:24.416453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 460/917] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:24 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1261 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:37:24.437199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a8f5eeb3-4d11-4f67-aba9-9f3ebfaf3857 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "POST /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.457630 Aug 22 17:37:24.438054 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 458/918] 10.222.0.20 () {62 vars in 1364 bytes} [Mon Aug 22 17:37:22 2022] POST /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da/os-volume_attachments => generated 188 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 22 17:37:24.621389 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4900c064-8dd5-4b7e-ad00-97baef2020e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:24.622182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4900c064-8dd5-4b7e-ad00-97baef2020e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:24.632670 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4900c064-8dd5-4b7e-ad00-97baef2020e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:24.633215 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4900c064-8dd5-4b7e-ad00-97baef2020e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:24.633721 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4900c064-8dd5-4b7e-ad00-97baef2020e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:24.634733 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4900c064-8dd5-4b7e-ad00-97baef2020e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:24.635197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4900c064-8dd5-4b7e-ad00-97baef2020e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:24.635662 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4900c064-8dd5-4b7e-ad00-97baef2020e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:25.384646 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4900c064-8dd5-4b7e-ad00-97baef2020e7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da/os-volume_attachments/9a0af371-7430-4fc6-bd32-10b3479ff2ee" status: 202 len: 0 microversion: 2.20 time: 0.769390 Aug 22 17:37:25.385437 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 461/919] 10.222.0.20 () {60 vars in 1457 bytes} [Mon Aug 22 17:37:24 2022] DELETE /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da/os-volume_attachments/9a0af371-7430-4fc6-bd32-10b3479ff2ee => generated 0 bytes in 771 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:37:25.432513 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-9f99c0fc-52c1-47c2-a66c-d70de6795217 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:25.433583 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9f99c0fc-52c1-47c2-a66c-d70de6795217 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:25.448932 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9f99c0fc-52c1-47c2-a66c-d70de6795217 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:25.449687 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c210999f-e477-4af7-b9b2-8a85a22f55e2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:37:25.449840 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9f99c0fc-52c1-47c2-a66c-d70de6795217 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:25.450010 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c210999f-e477-4af7-b9b2-8a85a22f55e2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:25.450815 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9f99c0fc-52c1-47c2-a66c-d70de6795217 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:25.452462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9f99c0fc-52c1-47c2-a66c-d70de6795217 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:25.453247 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9f99c0fc-52c1-47c2-a66c-d70de6795217 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:25.453726 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9f99c0fc-52c1-47c2-a66c-d70de6795217 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:25.457819 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c210999f-e477-4af7-b9b2-8a85a22f55e2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:25.458312 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c210999f-e477-4af7-b9b2-8a85a22f55e2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:25.458787 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c210999f-e477-4af7-b9b2-8a85a22f55e2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:25.458950 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:37:25.459673 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c210999f-e477-4af7-b9b2-8a85a22f55e2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:25.460310 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c210999f-e477-4af7-b9b2-8a85a22f55e2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:25.460561 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c210999f-e477-4af7-b9b2-8a85a22f55e2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:25.519423 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c210999f-e477-4af7-b9b2-8a85a22f55e2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121852) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 17:37:25.608615 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-9f99c0fc-52c1-47c2-a66c-d70de6795217 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:25.618216 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-9f99c0fc-52c1-47c2-a66c-d70de6795217 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1443 microversion: 2.1 time: 0.193023 Aug 22 17:37:25.618832 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 459/920] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:25 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1443 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:37:25.650320 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6457809e-623b-47a8-ac8a-1ace27a0551c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:25.793977 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6457809e-623b-47a8-ac8a-1ace27a0551c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:25.793977 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6457809e-623b-47a8-ac8a-1ace27a0551c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:25.793977 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6457809e-623b-47a8-ac8a-1ace27a0551c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:25.793977 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6457809e-623b-47a8-ac8a-1ace27a0551c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:25.794952 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6457809e-623b-47a8-ac8a-1ace27a0551c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:25.794952 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6457809e-623b-47a8-ac8a-1ace27a0551c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:25.794952 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6457809e-623b-47a8-ac8a-1ace27a0551c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:25.810817 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6457809e-623b-47a8-ac8a-1ace27a0551c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:25.822190 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6457809e-623b-47a8-ac8a-1ace27a0551c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1443 microversion: 2.1 time: 0.180243 Aug 22 17:37:25.822816 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 460/921] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:37:25 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1443 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:37:25.975511 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c210999f-e477-4af7-b9b2-8a85a22f55e2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "POST /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da/action" status: 202 len: 0 microversion: 2.20 time: 0.530489 Aug 22 17:37:25.976799 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 462/922] 10.222.0.20 () {62 vars in 1319 bytes} [Mon Aug 22 17:37:25 2022] POST /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:37:25.987505 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-23ab0fcf-06a2-4ca4-ad2b-1c5f77ed872a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:25.988150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-23ab0fcf-06a2-4ca4-ad2b-1c5f77ed872a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:25.998165 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-23ab0fcf-06a2-4ca4-ad2b-1c5f77ed872a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:25.999325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-23ab0fcf-06a2-4ca4-ad2b-1c5f77ed872a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:25.999325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-23ab0fcf-06a2-4ca4-ad2b-1c5f77ed872a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:25.999806 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-23ab0fcf-06a2-4ca4-ad2b-1c5f77ed872a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:26.000373 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-23ab0fcf-06a2-4ca4-ad2b-1c5f77ed872a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:26.000800 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-23ab0fcf-06a2-4ca4-ad2b-1c5f77ed872a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:26.174298 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-23ab0fcf-06a2-4ca4-ad2b-1c5f77ed872a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:26.192485 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-23ab0fcf-06a2-4ca4-ad2b-1c5f77ed872a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:26.195791 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-23ab0fcf-06a2-4ca4-ad2b-1c5f77ed872a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:26.197925 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-23ab0fcf-06a2-4ca4-ad2b-1c5f77ed872a tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1670 microversion: 2.20 time: 0.215240 Aug 22 17:37:26.210506 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 461/923] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:25 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1670 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:27.232606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0aa4d719-02be-40a7-840c-8410053d4e49 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:27.233772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0aa4d719-02be-40a7-840c-8410053d4e49 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:27.248633 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0aa4d719-02be-40a7-840c-8410053d4e49 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:27.249577 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0aa4d719-02be-40a7-840c-8410053d4e49 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:27.250355 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0aa4d719-02be-40a7-840c-8410053d4e49 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:27.251929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0aa4d719-02be-40a7-840c-8410053d4e49 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:27.252990 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0aa4d719-02be-40a7-840c-8410053d4e49 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:27.255436 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0aa4d719-02be-40a7-840c-8410053d4e49 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:27.739666 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0aa4d719-02be-40a7-840c-8410053d4e49 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:27.748018 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0aa4d719-02be-40a7-840c-8410053d4e49 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:27.749516 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0aa4d719-02be-40a7-840c-8410053d4e49 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:27.750708 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0aa4d719-02be-40a7-840c-8410053d4e49 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1670 microversion: 2.20 time: 0.531173 Aug 22 17:37:27.751401 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 463/924] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:27 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1670 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:28.776731 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-01fa5454-66b3-4e39-8c63-738136396ac3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:28.777663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-01fa5454-66b3-4e39-8c63-738136396ac3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:28.780547 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:37:28.787447 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-01fa5454-66b3-4e39-8c63-738136396ac3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:28.788213 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-01fa5454-66b3-4e39-8c63-738136396ac3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:28.789258 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-01fa5454-66b3-4e39-8c63-738136396ac3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:28.790589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-01fa5454-66b3-4e39-8c63-738136396ac3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:28.792055 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-01fa5454-66b3-4e39-8c63-738136396ac3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:28.792300 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-01fa5454-66b3-4e39-8c63-738136396ac3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:28.971431 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-61b4c2bc-7f7f-437f-9534-da0a75553419 req-68496e60-0fb3-4c3c-83c7-744b1c513069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c5d826-b574-453f-9bb2-d7d6f8b6bb15", "tag": "abca211f-f649-45c4-8d69-21154b866c5b"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:37:28.977992 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:37:28.987092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-61b4c2bc-7f7f-437f-9534-da0a75553419 req-68496e60-0fb3-4c3c-83c7-744b1c513069 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:28.990513 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-61b4c2bc-7f7f-437f-9534-da0a75553419 req-68496e60-0fb3-4c3c-83c7-744b1c513069 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:28.990513 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-61b4c2bc-7f7f-437f-9534-da0a75553419 req-68496e60-0fb3-4c3c-83c7-744b1c513069 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:29.001664 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-61b4c2bc-7f7f-437f-9534-da0a75553419 req-68496e60-0fb3-4c3c-83c7-744b1c513069 service nova] Creating event network-changed:abca211f-f649-45c4-8d69-21154b866c5b for instance 08c5d826-b574-453f-9bb2-d7d6f8b6bb15 on hv-cinder-85394 Aug 22 17:37:29.008444 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-61b4c2bc-7f7f-437f-9534-da0a75553419 req-68496e60-0fb3-4c3c-83c7-744b1c513069 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138359 Aug 22 17:37:29.009322 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 464/925] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:37:29.077045 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-01fa5454-66b3-4e39-8c63-738136396ac3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:29.088363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-01fa5454-66b3-4e39-8c63-738136396ac3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:29.090339 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-01fa5454-66b3-4e39-8c63-738136396ac3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:29.091759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-01fa5454-66b3-4e39-8c63-738136396ac3 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.319496 Aug 22 17:37:29.092502 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 462/926] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:28 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:30.117678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-052357a4-65a0-4c76-aa58-3a35813f4d4b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:30.118453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-052357a4-65a0-4c76-aa58-3a35813f4d4b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:30.126151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-052357a4-65a0-4c76-aa58-3a35813f4d4b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:30.127525 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-052357a4-65a0-4c76-aa58-3a35813f4d4b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:30.128045 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-052357a4-65a0-4c76-aa58-3a35813f4d4b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:30.128811 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-052357a4-65a0-4c76-aa58-3a35813f4d4b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:30.129285 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-052357a4-65a0-4c76-aa58-3a35813f4d4b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:30.129970 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-052357a4-65a0-4c76-aa58-3a35813f4d4b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:30.398167 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-052357a4-65a0-4c76-aa58-3a35813f4d4b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:30.413978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-052357a4-65a0-4c76-aa58-3a35813f4d4b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:30.415714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-052357a4-65a0-4c76-aa58-3a35813f4d4b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:30.417051 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-052357a4-65a0-4c76-aa58-3a35813f4d4b tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.304852 Aug 22 17:37:30.433391 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 465/927] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:30 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:31.441414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-7e0717ec-bbc7-483c-a274-bac5189aed60 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:31.443574 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-7e0717ec-bbc7-483c-a274-bac5189aed60 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:31.451681 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e0717ec-bbc7-483c-a274-bac5189aed60 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:31.452810 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e0717ec-bbc7-483c-a274-bac5189aed60 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:31.453510 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e0717ec-bbc7-483c-a274-bac5189aed60 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:31.455290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e0717ec-bbc7-483c-a274-bac5189aed60 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:31.456001 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e0717ec-bbc7-483c-a274-bac5189aed60 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:31.456688 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7e0717ec-bbc7-483c-a274-bac5189aed60 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:31.636930 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7e0717ec-bbc7-483c-a274-bac5189aed60 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:31.647471 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7e0717ec-bbc7-483c-a274-bac5189aed60 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:31.651340 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7e0717ec-bbc7-483c-a274-bac5189aed60 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:31.651340 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-7e0717ec-bbc7-483c-a274-bac5189aed60 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.213611 Aug 22 17:37:31.651754 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 463/928] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:31 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:32.686032 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b28727a4-f99d-4045-9ab7-45f85302a839 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:32.687493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b28727a4-f99d-4045-9ab7-45f85302a839 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:32.700071 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b28727a4-f99d-4045-9ab7-45f85302a839 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:32.701210 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b28727a4-f99d-4045-9ab7-45f85302a839 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:32.701776 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b28727a4-f99d-4045-9ab7-45f85302a839 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:32.702706 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b28727a4-f99d-4045-9ab7-45f85302a839 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:32.703399 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b28727a4-f99d-4045-9ab7-45f85302a839 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:32.703943 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b28727a4-f99d-4045-9ab7-45f85302a839 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:32.900947 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b28727a4-f99d-4045-9ab7-45f85302a839 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:32.910624 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b28727a4-f99d-4045-9ab7-45f85302a839 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:32.912124 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b28727a4-f99d-4045-9ab7-45f85302a839 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:32.913321 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b28727a4-f99d-4045-9ab7-45f85302a839 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.237609 Aug 22 17:37:32.913918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 466/929] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:32 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:33.944564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-89f4ad68-6d64-4a2d-a0aa-d7e34ba2b4df tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:33.945747 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-89f4ad68-6d64-4a2d-a0aa-d7e34ba2b4df tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:33.958107 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89f4ad68-6d64-4a2d-a0aa-d7e34ba2b4df tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:33.958996 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89f4ad68-6d64-4a2d-a0aa-d7e34ba2b4df tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:33.959764 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89f4ad68-6d64-4a2d-a0aa-d7e34ba2b4df tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:33.961675 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89f4ad68-6d64-4a2d-a0aa-d7e34ba2b4df tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:33.962543 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89f4ad68-6d64-4a2d-a0aa-d7e34ba2b4df tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:33.963639 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-89f4ad68-6d64-4a2d-a0aa-d7e34ba2b4df tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:34.194356 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-89f4ad68-6d64-4a2d-a0aa-d7e34ba2b4df tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:34.203921 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-89f4ad68-6d64-4a2d-a0aa-d7e34ba2b4df tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:34.205818 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-89f4ad68-6d64-4a2d-a0aa-d7e34ba2b4df tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:34.208876 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-89f4ad68-6d64-4a2d-a0aa-d7e34ba2b4df tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.272998 Aug 22 17:37:34.223202 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 464/930] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:33 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:35.233704 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-07b24b2f-74e0-42e6-8edc-1411cc68e2d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:35.234616 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-07b24b2f-74e0-42e6-8edc-1411cc68e2d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:35.245604 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07b24b2f-74e0-42e6-8edc-1411cc68e2d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:35.246310 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07b24b2f-74e0-42e6-8edc-1411cc68e2d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:35.246931 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07b24b2f-74e0-42e6-8edc-1411cc68e2d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:35.248205 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07b24b2f-74e0-42e6-8edc-1411cc68e2d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:35.249054 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07b24b2f-74e0-42e6-8edc-1411cc68e2d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:35.249842 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07b24b2f-74e0-42e6-8edc-1411cc68e2d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:35.481934 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-07b24b2f-74e0-42e6-8edc-1411cc68e2d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:35.497149 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-07b24b2f-74e0-42e6-8edc-1411cc68e2d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:35.499794 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-07b24b2f-74e0-42e6-8edc-1411cc68e2d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:35.503090 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-07b24b2f-74e0-42e6-8edc-1411cc68e2d0 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.273920 Aug 22 17:37:35.503925 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 467/931] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:35 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:36.545921 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4395cb88-643a-4702-95c5-a6a75d39d783 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:36.546654 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4395cb88-643a-4702-95c5-a6a75d39d783 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:36.556052 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4395cb88-643a-4702-95c5-a6a75d39d783 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:36.556646 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4395cb88-643a-4702-95c5-a6a75d39d783 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:36.557170 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4395cb88-643a-4702-95c5-a6a75d39d783 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:36.558022 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4395cb88-643a-4702-95c5-a6a75d39d783 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:36.558505 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4395cb88-643a-4702-95c5-a6a75d39d783 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:36.559040 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4395cb88-643a-4702-95c5-a6a75d39d783 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:36.791466 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4395cb88-643a-4702-95c5-a6a75d39d783 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:36.803950 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4395cb88-643a-4702-95c5-a6a75d39d783 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:36.805841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4395cb88-643a-4702-95c5-a6a75d39d783 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:36.807464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4395cb88-643a-4702-95c5-a6a75d39d783 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.265609 Aug 22 17:37:36.808160 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 465/932] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:36 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:37.837003 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-280964c8-7347-44f2-954b-585365f1b89e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:37.838353 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-280964c8-7347-44f2-954b-585365f1b89e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:37.851263 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-280964c8-7347-44f2-954b-585365f1b89e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:37.856810 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-280964c8-7347-44f2-954b-585365f1b89e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:37.856810 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-280964c8-7347-44f2-954b-585365f1b89e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:37.856810 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-280964c8-7347-44f2-954b-585365f1b89e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:37.856810 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-280964c8-7347-44f2-954b-585365f1b89e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:37.857454 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-280964c8-7347-44f2-954b-585365f1b89e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:37.876883 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:37:38.037096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-280964c8-7347-44f2-954b-585365f1b89e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:38.047289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-280964c8-7347-44f2-954b-585365f1b89e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:38.049504 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-280964c8-7347-44f2-954b-585365f1b89e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:38.051272 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-280964c8-7347-44f2-954b-585365f1b89e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.222377 Aug 22 17:37:38.052410 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 468/933] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:37 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:39.085291 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-118062a0-ea7e-4534-a6cc-175f7ccc29d1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:39.086892 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-118062a0-ea7e-4534-a6cc-175f7ccc29d1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:39.099055 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-118062a0-ea7e-4534-a6cc-175f7ccc29d1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:39.100008 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-118062a0-ea7e-4534-a6cc-175f7ccc29d1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:39.100912 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-118062a0-ea7e-4534-a6cc-175f7ccc29d1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:39.102203 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-118062a0-ea7e-4534-a6cc-175f7ccc29d1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:39.103136 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-118062a0-ea7e-4534-a6cc-175f7ccc29d1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:39.103938 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-118062a0-ea7e-4534-a6cc-175f7ccc29d1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:39.304906 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-118062a0-ea7e-4534-a6cc-175f7ccc29d1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:39.314106 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-118062a0-ea7e-4534-a6cc-175f7ccc29d1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:39.315905 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-118062a0-ea7e-4534-a6cc-175f7ccc29d1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:39.317160 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-118062a0-ea7e-4534-a6cc-175f7ccc29d1 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.242488 Aug 22 17:37:39.318117 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 466/934] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:39 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:40.356978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c1b0607d-15fc-4aa4-8262-fe3b71bdffd2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:40.357644 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c1b0607d-15fc-4aa4-8262-fe3b71bdffd2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:40.365825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c1b0607d-15fc-4aa4-8262-fe3b71bdffd2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:40.366375 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c1b0607d-15fc-4aa4-8262-fe3b71bdffd2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:40.366962 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c1b0607d-15fc-4aa4-8262-fe3b71bdffd2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:40.367809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c1b0607d-15fc-4aa4-8262-fe3b71bdffd2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:40.368276 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c1b0607d-15fc-4aa4-8262-fe3b71bdffd2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:40.368745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c1b0607d-15fc-4aa4-8262-fe3b71bdffd2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:40.535062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c1b0607d-15fc-4aa4-8262-fe3b71bdffd2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:40.544911 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c1b0607d-15fc-4aa4-8262-fe3b71bdffd2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:40.546767 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c1b0607d-15fc-4aa4-8262-fe3b71bdffd2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:40.548768 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c1b0607d-15fc-4aa4-8262-fe3b71bdffd2 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.195904 Aug 22 17:37:40.549493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 469/935] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:40 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:41.573424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1556131e-a856-4ed2-afd6-4dbbb519b443 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:41.574142 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1556131e-a856-4ed2-afd6-4dbbb519b443 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:41.583098 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1556131e-a856-4ed2-afd6-4dbbb519b443 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:41.593455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1556131e-a856-4ed2-afd6-4dbbb519b443 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:41.593455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1556131e-a856-4ed2-afd6-4dbbb519b443 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:41.593455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1556131e-a856-4ed2-afd6-4dbbb519b443 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:41.593455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1556131e-a856-4ed2-afd6-4dbbb519b443 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:41.594025 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1556131e-a856-4ed2-afd6-4dbbb519b443 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:41.772350 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1556131e-a856-4ed2-afd6-4dbbb519b443 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:41.781086 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1556131e-a856-4ed2-afd6-4dbbb519b443 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:41.783505 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1556131e-a856-4ed2-afd6-4dbbb519b443 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:41.784736 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1556131e-a856-4ed2-afd6-4dbbb519b443 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.215852 Aug 22 17:37:41.785300 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 467/936] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:41 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:42.808165 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-afcd425b-b695-4bf8-a23e-07156ab7c56c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:42.808957 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-afcd425b-b695-4bf8-a23e-07156ab7c56c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:42.816359 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afcd425b-b695-4bf8-a23e-07156ab7c56c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:42.816961 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afcd425b-b695-4bf8-a23e-07156ab7c56c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:42.817270 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afcd425b-b695-4bf8-a23e-07156ab7c56c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:42.818007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afcd425b-b695-4bf8-a23e-07156ab7c56c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:42.818460 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afcd425b-b695-4bf8-a23e-07156ab7c56c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:42.825972 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afcd425b-b695-4bf8-a23e-07156ab7c56c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:42.994223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-afcd425b-b695-4bf8-a23e-07156ab7c56c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:43.003411 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-afcd425b-b695-4bf8-a23e-07156ab7c56c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:43.005219 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-afcd425b-b695-4bf8-a23e-07156ab7c56c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:43.006438 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-afcd425b-b695-4bf8-a23e-07156ab7c56c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.202255 Aug 22 17:37:43.007040 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 470/937] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:42 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:44.029556 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-10101a20-defc-4cf0-9122-2ea323982f4e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:44.030259 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-10101a20-defc-4cf0-9122-2ea323982f4e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:44.036966 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-10101a20-defc-4cf0-9122-2ea323982f4e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:44.037459 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-10101a20-defc-4cf0-9122-2ea323982f4e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:44.037896 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-10101a20-defc-4cf0-9122-2ea323982f4e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:44.038647 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-10101a20-defc-4cf0-9122-2ea323982f4e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:44.039108 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-10101a20-defc-4cf0-9122-2ea323982f4e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:44.039532 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-10101a20-defc-4cf0-9122-2ea323982f4e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:44.190181 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-10101a20-defc-4cf0-9122-2ea323982f4e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:44.198731 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-10101a20-defc-4cf0-9122-2ea323982f4e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:44.200241 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-10101a20-defc-4cf0-9122-2ea323982f4e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:44.201407 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-10101a20-defc-4cf0-9122-2ea323982f4e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.176062 Aug 22 17:37:44.201953 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 468/938] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:44 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:45.226291 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-bdebb9a2-d349-4e35-b8c7-d6736f42920c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:45.227041 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-bdebb9a2-d349-4e35-b8c7-d6736f42920c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:45.233581 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bdebb9a2-d349-4e35-b8c7-d6736f42920c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:45.234066 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bdebb9a2-d349-4e35-b8c7-d6736f42920c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:45.234512 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bdebb9a2-d349-4e35-b8c7-d6736f42920c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:45.236000 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bdebb9a2-d349-4e35-b8c7-d6736f42920c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:45.236453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bdebb9a2-d349-4e35-b8c7-d6736f42920c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:45.236873 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bdebb9a2-d349-4e35-b8c7-d6736f42920c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:45.379226 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-bdebb9a2-d349-4e35-b8c7-d6736f42920c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:45.388772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-bdebb9a2-d349-4e35-b8c7-d6736f42920c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:45.390270 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-bdebb9a2-d349-4e35-b8c7-d6736f42920c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:45.392466 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-bdebb9a2-d349-4e35-b8c7-d6736f42920c tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.169915 Aug 22 17:37:45.393194 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 471/939] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:45 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:46.415915 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ba835da1-7563-428c-bfa5-d02493e2462e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:46.416837 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ba835da1-7563-428c-bfa5-d02493e2462e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:46.424288 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ba835da1-7563-428c-bfa5-d02493e2462e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:46.424783 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ba835da1-7563-428c-bfa5-d02493e2462e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:46.425218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ba835da1-7563-428c-bfa5-d02493e2462e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:46.425928 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ba835da1-7563-428c-bfa5-d02493e2462e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:46.426376 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ba835da1-7563-428c-bfa5-d02493e2462e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:46.426899 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ba835da1-7563-428c-bfa5-d02493e2462e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:46.592235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ba835da1-7563-428c-bfa5-d02493e2462e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:46.608395 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ba835da1-7563-428c-bfa5-d02493e2462e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:46.612525 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ba835da1-7563-428c-bfa5-d02493e2462e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:46.614761 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ba835da1-7563-428c-bfa5-d02493e2462e tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.202644 Aug 22 17:37:46.615987 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 469/940] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:46 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:47.645688 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-569b64a9-de19-426d-a8de-a8f1a6bd4959 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:47.646367 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-569b64a9-de19-426d-a8de-a8f1a6bd4959 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:47.653417 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-569b64a9-de19-426d-a8de-a8f1a6bd4959 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:47.653921 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-569b64a9-de19-426d-a8de-a8f1a6bd4959 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:47.654500 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-569b64a9-de19-426d-a8de-a8f1a6bd4959 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:47.655240 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-569b64a9-de19-426d-a8de-a8f1a6bd4959 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:47.655703 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-569b64a9-de19-426d-a8de-a8f1a6bd4959 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:47.656130 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-569b64a9-de19-426d-a8de-a8f1a6bd4959 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:47.811361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-569b64a9-de19-426d-a8de-a8f1a6bd4959 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:47.822165 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-569b64a9-de19-426d-a8de-a8f1a6bd4959 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:47.823786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-569b64a9-de19-426d-a8de-a8f1a6bd4959 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:47.825355 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-569b64a9-de19-426d-a8de-a8f1a6bd4959 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.184817 Aug 22 17:37:47.825990 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 472/941] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:47 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:48.565145 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-df4a9b41-dc03-4490-8d65-bd663255e1d5 req-e527155b-d384-49cc-82d3-fd5d9df95648 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a67bb4-4540-4e14-a7bc-74bf8ca080da", "name": "network-vif-plugged", "status": "completed", "tag": "c93f66cf-3a0a-41e2-a4a1-03d394f2cce2"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:37:48.578059 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-df4a9b41-dc03-4490-8d65-bd663255e1d5 req-e527155b-d384-49cc-82d3-fd5d9df95648 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:48.578680 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-df4a9b41-dc03-4490-8d65-bd663255e1d5 req-e527155b-d384-49cc-82d3-fd5d9df95648 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:48.579492 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-df4a9b41-dc03-4490-8d65-bd663255e1d5 req-e527155b-d384-49cc-82d3-fd5d9df95648 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:48.591977 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-df4a9b41-dc03-4490-8d65-bd663255e1d5 req-e527155b-d384-49cc-82d3-fd5d9df95648 service nova] Creating event network-vif-plugged:c93f66cf-3a0a-41e2-a4a1-03d394f2cce2 for instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da on hv-cinder-85394 Aug 22 17:37:48.597604 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-df4a9b41-dc03-4490-8d65-bd663255e1d5 req-e527155b-d384-49cc-82d3-fd5d9df95648 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037109 Aug 22 17:37:48.598220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 470/942] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:37:48.850598 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-cebe3dee-a7e5-4c4e-a0b7-2411771909cb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:48.851595 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-cebe3dee-a7e5-4c4e-a0b7-2411771909cb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:48.858817 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cebe3dee-a7e5-4c4e-a0b7-2411771909cb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:48.859322 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cebe3dee-a7e5-4c4e-a0b7-2411771909cb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:48.860308 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cebe3dee-a7e5-4c4e-a0b7-2411771909cb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:48.861483 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cebe3dee-a7e5-4c4e-a0b7-2411771909cb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:48.861946 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cebe3dee-a7e5-4c4e-a0b7-2411771909cb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:48.862374 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cebe3dee-a7e5-4c4e-a0b7-2411771909cb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:49.095528 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-cebe3dee-a7e5-4c4e-a0b7-2411771909cb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:49.105483 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-cebe3dee-a7e5-4c4e-a0b7-2411771909cb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:49.107265 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-cebe3dee-a7e5-4c4e-a0b7-2411771909cb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:49.108508 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-cebe3dee-a7e5-4c4e-a0b7-2411771909cb tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.262686 Aug 22 17:37:49.109087 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 473/943] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:48 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:37:50.133546 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-21725571-5852-419e-9d2f-523d00a1a899 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:50.134240 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-21725571-5852-419e-9d2f-523d00a1a899 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:50.141539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21725571-5852-419e-9d2f-523d00a1a899 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:50.142038 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21725571-5852-419e-9d2f-523d00a1a899 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:50.142499 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21725571-5852-419e-9d2f-523d00a1a899 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:50.143230 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21725571-5852-419e-9d2f-523d00a1a899 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:50.143683 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21725571-5852-419e-9d2f-523d00a1a899 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:50.144110 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21725571-5852-419e-9d2f-523d00a1a899 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:50.302083 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-21725571-5852-419e-9d2f-523d00a1a899 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:50.317956 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-21725571-5852-419e-9d2f-523d00a1a899 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:50.320885 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-21725571-5852-419e-9d2f-523d00a1a899 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:50.322998 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-21725571-5852-419e-9d2f-523d00a1a899 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.194318 Aug 22 17:37:50.324666 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 471/944] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:50 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:51.357538 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-854e2d4b-24d8-4d66-9a15-c407c56e6fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:51.358163 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-854e2d4b-24d8-4d66-9a15-c407c56e6fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:51.365684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-854e2d4b-24d8-4d66-9a15-c407c56e6fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:51.366182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-854e2d4b-24d8-4d66-9a15-c407c56e6fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:51.366651 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-854e2d4b-24d8-4d66-9a15-c407c56e6fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:51.367413 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-854e2d4b-24d8-4d66-9a15-c407c56e6fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:51.367904 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-854e2d4b-24d8-4d66-9a15-c407c56e6fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:51.368394 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-854e2d4b-24d8-4d66-9a15-c407c56e6fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:51.518263 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-854e2d4b-24d8-4d66-9a15-c407c56e6fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:51.527861 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-854e2d4b-24d8-4d66-9a15-c407c56e6fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:51.528779 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-854e2d4b-24d8-4d66-9a15-c407c56e6fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:51.529974 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-854e2d4b-24d8-4d66-9a15-c407c56e6fa5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.176599 Aug 22 17:37:51.530550 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 474/945] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:51 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:52.553824 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ed1eb2e0-3a96-4f1c-9001-754ced1213f8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:52.554444 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ed1eb2e0-3a96-4f1c-9001-754ced1213f8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:52.561020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ed1eb2e0-3a96-4f1c-9001-754ced1213f8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:52.561506 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ed1eb2e0-3a96-4f1c-9001-754ced1213f8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:52.561937 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ed1eb2e0-3a96-4f1c-9001-754ced1213f8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:52.563391 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ed1eb2e0-3a96-4f1c-9001-754ced1213f8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:52.564425 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ed1eb2e0-3a96-4f1c-9001-754ced1213f8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:52.564846 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ed1eb2e0-3a96-4f1c-9001-754ced1213f8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:52.734321 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ed1eb2e0-3a96-4f1c-9001-754ced1213f8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:52.744443 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ed1eb2e0-3a96-4f1c-9001-754ced1213f8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:52.745980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ed1eb2e0-3a96-4f1c-9001-754ced1213f8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:52.747259 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ed1eb2e0-3a96-4f1c-9001-754ced1213f8 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1728 microversion: 2.20 time: 0.197628 Aug 22 17:37:52.747858 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 472/946] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:52 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1728 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:37:53.773321 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-22013a4a-5748-4ff8-af9c-85e1ce04aee5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:37:53.774317 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-22013a4a-5748-4ff8-af9c-85e1ce04aee5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:37:53.781053 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-22013a4a-5748-4ff8-af9c-85e1ce04aee5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:53.781585 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-22013a4a-5748-4ff8-af9c-85e1ce04aee5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:53.782031 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-22013a4a-5748-4ff8-af9c-85e1ce04aee5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:53.782792 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-22013a4a-5748-4ff8-af9c-85e1ce04aee5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:37:53.783236 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-22013a4a-5748-4ff8-af9c-85e1ce04aee5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:37:53.783674 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-22013a4a-5748-4ff8-af9c-85e1ce04aee5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:37:53.948436 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-22013a4a-5748-4ff8-af9c-85e1ce04aee5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:53.959211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-22013a4a-5748-4ff8-af9c-85e1ce04aee5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:53.960860 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-22013a4a-5748-4ff8-af9c-85e1ce04aee5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:37:53.962191 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-22013a4a-5748-4ff8-af9c-85e1ce04aee5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1715 microversion: 2.20 time: 0.193489 Aug 22 17:37:53.962835 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 475/947] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:37:53 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1715 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:38:05.651769 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e82abd53-fef6-4c8d-ab0a-05cf6db4d1fa tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:05.652441 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e82abd53-fef6-4c8d-ab0a-05cf6db4d1fa tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:05.654956 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=21 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:05.655636 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=78 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:05.661168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e82abd53-fef6-4c8d-ab0a-05cf6db4d1fa tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:05.666799 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e82abd53-fef6-4c8d-ab0a-05cf6db4d1fa tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:05.666799 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e82abd53-fef6-4c8d-ab0a-05cf6db4d1fa tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:05.666799 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e82abd53-fef6-4c8d-ab0a-05cf6db4d1fa tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:05.666799 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e82abd53-fef6-4c8d-ab0a-05cf6db4d1fa tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:05.667439 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e82abd53-fef6-4c8d-ab0a-05cf6db4d1fa tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:05.692523 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e82abd53-fef6-4c8d-ab0a-05cf6db4d1fa tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Going to try to terminate instance {{(pid=121853) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:38:06.081796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e82abd53-fef6-4c8d-ab0a-05cf6db4d1fa tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 204 len: 0 microversion: 2.1 time: 0.433737 Aug 22 17:38:06.082400 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 473/948] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:38:05 2022] DELETE /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 22 17:38:06.091634 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4b46c16c-b8b5-41a5-b458-a545cde63235 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:06.092285 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4b46c16c-b8b5-41a5-b458-a545cde63235 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:06.095591 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=23 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:06.096275 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=45 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:06.101298 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4b46c16c-b8b5-41a5-b458-a545cde63235 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:06.101805 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4b46c16c-b8b5-41a5-b458-a545cde63235 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:06.102254 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4b46c16c-b8b5-41a5-b458-a545cde63235 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:06.103309 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4b46c16c-b8b5-41a5-b458-a545cde63235 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:06.103495 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4b46c16c-b8b5-41a5-b458-a545cde63235 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:06.103872 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4b46c16c-b8b5-41a5-b458-a545cde63235 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:06.264838 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4b46c16c-b8b5-41a5-b458-a545cde63235 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:06.274003 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4b46c16c-b8b5-41a5-b458-a545cde63235 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1577 microversion: 2.1 time: 0.186314 Aug 22 17:38:06.274642 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 476/949] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:06 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1577 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:07.297886 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-efb87b49-ac25-4d9c-8606-06e953a5bd0f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:07.298652 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-efb87b49-ac25-4d9c-8606-06e953a5bd0f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:07.305713 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efb87b49-ac25-4d9c-8606-06e953a5bd0f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:07.306206 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efb87b49-ac25-4d9c-8606-06e953a5bd0f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:07.306684 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efb87b49-ac25-4d9c-8606-06e953a5bd0f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:07.307405 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efb87b49-ac25-4d9c-8606-06e953a5bd0f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:07.307858 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efb87b49-ac25-4d9c-8606-06e953a5bd0f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:07.308286 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-efb87b49-ac25-4d9c-8606-06e953a5bd0f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:07.462029 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-efb87b49-ac25-4d9c-8606-06e953a5bd0f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:07.470862 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-efb87b49-ac25-4d9c-8606-06e953a5bd0f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1577 microversion: 2.1 time: 0.178388 Aug 22 17:38:07.471457 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 474/950] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:07 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:08.497640 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-514dfd3b-435c-475e-b62b-6aa1119c9e40 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:08.499103 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-514dfd3b-435c-475e-b62b-6aa1119c9e40 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:08.511859 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-514dfd3b-435c-475e-b62b-6aa1119c9e40 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:08.513072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-514dfd3b-435c-475e-b62b-6aa1119c9e40 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:08.513709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-514dfd3b-435c-475e-b62b-6aa1119c9e40 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:08.515084 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-514dfd3b-435c-475e-b62b-6aa1119c9e40 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:08.516374 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-514dfd3b-435c-475e-b62b-6aa1119c9e40 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:08.517169 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-514dfd3b-435c-475e-b62b-6aa1119c9e40 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:08.741525 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-514dfd3b-435c-475e-b62b-6aa1119c9e40 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:08.753472 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-514dfd3b-435c-475e-b62b-6aa1119c9e40 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1577 microversion: 2.1 time: 0.261004 Aug 22 17:38:08.753472 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 477/951] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:08 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1577 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:09.205277 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-50bd35b9-bac0-4019-b325-299a0b37caa3 req-77aac82d-b1c5-4bc9-9aa4-4d9032e03a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da", "name": "network-vif-deleted", "tag": "7af37e22-6837-49b2-aecb-40646534c4b7"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:38:09.216387 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-50bd35b9-bac0-4019-b325-299a0b37caa3 req-77aac82d-b1c5-4bc9-9aa4-4d9032e03a41 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:09.217089 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-50bd35b9-bac0-4019-b325-299a0b37caa3 req-77aac82d-b1c5-4bc9-9aa4-4d9032e03a41 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:09.217729 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-50bd35b9-bac0-4019-b325-299a0b37caa3 req-77aac82d-b1c5-4bc9-9aa4-4d9032e03a41 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:09.231749 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-50bd35b9-bac0-4019-b325-299a0b37caa3 req-77aac82d-b1c5-4bc9-9aa4-4d9032e03a41 service nova] Creating event network-vif-deleted:7af37e22-6837-49b2-aecb-40646534c4b7 for instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da on hv-cinder-85394 Aug 22 17:38:09.237345 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-50bd35b9-bac0-4019-b325-299a0b37caa3 req-77aac82d-b1c5-4bc9-9aa4-4d9032e03a41 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036972 Aug 22 17:38:09.238730 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 475/952] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:38:09.779637 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8280147c-754b-49c3-a7c0-e7320531e822 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:09.781662 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8280147c-754b-49c3-a7c0-e7320531e822 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:09.793245 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8280147c-754b-49c3-a7c0-e7320531e822 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:09.794325 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8280147c-754b-49c3-a7c0-e7320531e822 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:09.800845 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8280147c-754b-49c3-a7c0-e7320531e822 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:09.800845 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8280147c-754b-49c3-a7c0-e7320531e822 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:09.800845 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8280147c-754b-49c3-a7c0-e7320531e822 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:09.800845 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8280147c-754b-49c3-a7c0-e7320531e822 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:09.870206 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8280147c-754b-49c3-a7c0-e7320531e822 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:09.879447 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8280147c-754b-49c3-a7c0-e7320531e822 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 200 len: 1224 microversion: 2.1 time: 0.105071 Aug 22 17:38:09.886118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 478/953] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:09 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 1224 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:10.903276 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2de8e26e-009e-4492-8273-7c867fea2753 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:10.904193 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2de8e26e-009e-4492-8273-7c867fea2753 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:10.912246 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2de8e26e-009e-4492-8273-7c867fea2753 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:10.912895 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2de8e26e-009e-4492-8273-7c867fea2753 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:10.913369 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2de8e26e-009e-4492-8273-7c867fea2753 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:10.914227 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2de8e26e-009e-4492-8273-7c867fea2753 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:10.914778 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2de8e26e-009e-4492-8273-7c867fea2753 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:10.915387 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2de8e26e-009e-4492-8273-7c867fea2753 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:10.932134 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-2de8e26e-009e-4492-8273-7c867fea2753 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] HTTP exception thrown: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2de8e26e-009e-4492-8273-7c867fea2753 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Request method failure captured: Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da HTTP/1.1 Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA74liqewjdrb1wZKL57D_hZWgcYD1SOs8ywPyYhT-ux42-l-CuMJWsVp6WoPh5QalsO8tcFo2_YHRDRmRpm7iLY4OM1hUjdhxXOI5-Vhp6b45jpgOXyF_YeyR2aWN-0d-1bNEF7vdyvieBE57sQWFZrFs78uZFO0SX_JLqZ7u3chpYk Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 43d4499a9d9f4c00a09c867bb403dd30 Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-TestVolumeBootPattern-883724751 Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:38:10.933916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:38:10.936486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43d4499a9d9f4c00a09c867bb403dd30", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:38:10.936486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-TestVolumeBootPattern-883724751 Aug 22 17:38:10.936486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 43d4499a9d9f4c00a09c867bb403dd30 Aug 22 17:38:10.936486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-TestVolumeBootPattern-883724751 Aug 22 17:38:10.936486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-TestVolumeBootPattern-883724751-project Aug 22 17:38:10.936486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:38:10.936486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:38:10.936486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: aa55b9fade0047c68c2f3f6bf4dfe44e Aug 22 17:38:10.936486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-TestVolumeBootPattern-883724751-project Aug 22 17:38:10.936486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:38:10.936486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:38:10.936486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': '2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da'} Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:38:10.939180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:38:10.941462 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:38:10.943897 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2de8e26e-009e-4492-8273-7c867fea2753 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Returning 404 to user: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:38:10.943897 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2de8e26e-009e-4492-8273-7c867fea2753 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 404 len: 111 microversion: 2.1 time: 0.037597 Aug 22 17:38:10.943897 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 476/954] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:10 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 22 17:38:11.055584 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-865342297", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-567724700", "security_groups": [{"name": "tempest-secgroup-smoke-1067862503"}], "block_device_mapping_v2": [{"uuid": "f1950448-aefb-4172-94e1-5be74a5d6a21", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e1445a90-112c-40f4-a9b4-b117c3489d79"}]}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:38:11.196300 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.network.neutron [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] validate_networks() for [('e1445a90-112c-40f4-a9b4-b117c3489d79', None, None, None, None, None)] {{(pid=121852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:38:11.722185 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Flavor limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:38:11.722659 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Image limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:38:11.723165 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Flavor pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:38:11.723572 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Image pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:38:11.723987 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:38:11.734425 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:11.735103 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:11.735750 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:11.736606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:11.737217 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:11.737742 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:11.759709 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Getting quotas for project 43d4499a9d9f4c00a09c867bb403dd30. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:38:11.766226 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Getting quotas for user aa55b9fade0047c68c2f3f6bf4dfe44e and project 43d4499a9d9f4c00a09c867bb403dd30. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:38:11.850789 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Going to run 1 instances... {{(pid=121852) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:38:11.853309 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1950448-aefb-4172-94e1-5be74a5d6a21',volume_size=None,volume_type=None)] {{(pid=121852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:38:12.410102 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-bf79aa26-2268-44fa-97c8-0c2e20ef9749 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.358944 Aug 22 17:38:12.411365 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 479/955] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:38:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1361 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:38:12.423246 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cd0d5dca-9227-4680-97b0-fc1b49df6f24 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:12.423859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-cd0d5dca-9227-4680-97b0-fc1b49df6f24 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:12.487140 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-cd0d5dca-9227-4680-97b0-fc1b49df6f24 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:12.497402 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-cd0d5dca-9227-4680-97b0-fc1b49df6f24 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1093 microversion: 2.1 time: 0.079322 Aug 22 17:38:12.498141 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 477/956] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:12 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:13.523427 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e2258751-5d5e-4a63-b897-926c53e0add9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:13.524129 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e2258751-5d5e-4a63-b897-926c53e0add9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:13.533521 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e2258751-5d5e-4a63-b897-926c53e0add9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:13.534014 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e2258751-5d5e-4a63-b897-926c53e0add9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:13.534448 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e2258751-5d5e-4a63-b897-926c53e0add9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:13.535196 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e2258751-5d5e-4a63-b897-926c53e0add9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:13.535652 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e2258751-5d5e-4a63-b897-926c53e0add9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:13.536126 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e2258751-5d5e-4a63-b897-926c53e0add9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:13.602023 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e2258751-5d5e-4a63-b897-926c53e0add9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:13.612483 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e2258751-5d5e-4a63-b897-926c53e0add9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1143 microversion: 2.1 time: 0.094460 Aug 22 17:38:13.613599 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 480/957] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:13 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1143 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:14.635599 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0b599ac5-d115-4ecd-bf1b-558ab63b8964 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:14.636252 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0b599ac5-d115-4ecd-bf1b-558ab63b8964 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:14.643353 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0b599ac5-d115-4ecd-bf1b-558ab63b8964 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:14.650289 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0b599ac5-d115-4ecd-bf1b-558ab63b8964 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:14.650289 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0b599ac5-d115-4ecd-bf1b-558ab63b8964 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:14.650289 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0b599ac5-d115-4ecd-bf1b-558ab63b8964 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:14.650289 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0b599ac5-d115-4ecd-bf1b-558ab63b8964 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:14.651048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0b599ac5-d115-4ecd-bf1b-558ab63b8964 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:14.716259 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0b599ac5-d115-4ecd-bf1b-558ab63b8964 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:14.724524 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0b599ac5-d115-4ecd-bf1b-558ab63b8964 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1191 microversion: 2.1 time: 0.092929 Aug 22 17:38:14.725110 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 478/958] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:14 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1191 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:15.754032 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2b160aa8-6993-49cf-b320-2a271aa3857b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:15.754894 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-2b160aa8-6993-49cf-b320-2a271aa3857b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:15.762053 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2b160aa8-6993-49cf-b320-2a271aa3857b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:15.762581 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2b160aa8-6993-49cf-b320-2a271aa3857b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:15.763157 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2b160aa8-6993-49cf-b320-2a271aa3857b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:15.763726 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2b160aa8-6993-49cf-b320-2a271aa3857b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:15.764175 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2b160aa8-6993-49cf-b320-2a271aa3857b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:15.765542 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2b160aa8-6993-49cf-b320-2a271aa3857b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:15.982719 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2b160aa8-6993-49cf-b320-2a271aa3857b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:15.993117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2b160aa8-6993-49cf-b320-2a271aa3857b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1277 microversion: 2.1 time: 0.242928 Aug 22 17:38:15.994543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 481/959] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:15 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:16.941191 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-8e63919f-ebb4-4d51-8d00-f468dcdd56ed req-dc359aa8-2060-4997-8f99-ddf8e0996456 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa975518-469e-47f3-8165-113b27287104", "tag": "20bb2f1b-c55a-4870-b4f7-4b9ad51f76f3"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:38:16.952458 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-8e63919f-ebb4-4d51-8d00-f468dcdd56ed req-dc359aa8-2060-4997-8f99-ddf8e0996456 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:16.952998 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-8e63919f-ebb4-4d51-8d00-f468dcdd56ed req-dc359aa8-2060-4997-8f99-ddf8e0996456 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:16.953542 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-8e63919f-ebb4-4d51-8d00-f468dcdd56ed req-dc359aa8-2060-4997-8f99-ddf8e0996456 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:16.969818 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-8e63919f-ebb4-4d51-8d00-f468dcdd56ed req-dc359aa8-2060-4997-8f99-ddf8e0996456 service nova] Creating event network-changed:20bb2f1b-c55a-4870-b4f7-4b9ad51f76f3 for instance fa975518-469e-47f3-8165-113b27287104 on hv-cinder-85394 Aug 22 17:38:16.975112 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-8e63919f-ebb4-4d51-8d00-f468dcdd56ed req-dc359aa8-2060-4997-8f99-ddf8e0996456 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038218 Aug 22 17:38:16.975723 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 479/960] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:38:17.017177 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-eb5f3bd3-da2e-4601-9e81-6df2d377b442 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:17.017798 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-eb5f3bd3-da2e-4601-9e81-6df2d377b442 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:17.027652 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eb5f3bd3-da2e-4601-9e81-6df2d377b442 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:17.027652 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eb5f3bd3-da2e-4601-9e81-6df2d377b442 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:17.027652 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eb5f3bd3-da2e-4601-9e81-6df2d377b442 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:17.027652 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eb5f3bd3-da2e-4601-9e81-6df2d377b442 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:17.028072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eb5f3bd3-da2e-4601-9e81-6df2d377b442 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:17.028072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eb5f3bd3-da2e-4601-9e81-6df2d377b442 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:17.560774 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-eb5f3bd3-da2e-4601-9e81-6df2d377b442 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:17.570066 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-eb5f3bd3-da2e-4601-9e81-6df2d377b442 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1265 microversion: 2.1 time: 0.557593 Aug 22 17:38:17.570723 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 482/961] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:17 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1265 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:18.594792 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5a5294f3-be77-4543-81d4-4399729025bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:18.595527 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5a5294f3-be77-4543-81d4-4399729025bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:18.601983 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5a5294f3-be77-4543-81d4-4399729025bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:18.602471 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5a5294f3-be77-4543-81d4-4399729025bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:18.602934 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5a5294f3-be77-4543-81d4-4399729025bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:18.603635 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5a5294f3-be77-4543-81d4-4399729025bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:18.604098 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5a5294f3-be77-4543-81d4-4399729025bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:18.604521 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5a5294f3-be77-4543-81d4-4399729025bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:18.755346 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5a5294f3-be77-4543-81d4-4399729025bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:18.763889 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5a5294f3-be77-4543-81d4-4399729025bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1265 microversion: 2.1 time: 0.174637 Aug 22 17:38:18.764476 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 480/962] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:18 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:19.786659 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ab09045c-1763-4594-9805-adba93ece5f1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:19.787423 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ab09045c-1763-4594-9805-adba93ece5f1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:19.794787 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ab09045c-1763-4594-9805-adba93ece5f1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:19.795334 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ab09045c-1763-4594-9805-adba93ece5f1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:19.795827 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ab09045c-1763-4594-9805-adba93ece5f1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:19.796587 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ab09045c-1763-4594-9805-adba93ece5f1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:19.797260 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ab09045c-1763-4594-9805-adba93ece5f1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:19.797705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ab09045c-1763-4594-9805-adba93ece5f1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:19.950241 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ab09045c-1763-4594-9805-adba93ece5f1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:19.959752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ab09045c-1763-4594-9805-adba93ece5f1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1265 microversion: 2.1 time: 0.176978 Aug 22 17:38:19.960421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 483/963] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:19 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:38:20.984322 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5db53b1c-31e1-49e2-8244-80896466f1d8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:20.984988 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5db53b1c-31e1-49e2-8244-80896466f1d8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:20.992070 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5db53b1c-31e1-49e2-8244-80896466f1d8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:20.992552 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5db53b1c-31e1-49e2-8244-80896466f1d8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:20.992986 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5db53b1c-31e1-49e2-8244-80896466f1d8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:20.993695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5db53b1c-31e1-49e2-8244-80896466f1d8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:20.994144 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5db53b1c-31e1-49e2-8244-80896466f1d8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:20.994595 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5db53b1c-31e1-49e2-8244-80896466f1d8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:21.151512 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5db53b1c-31e1-49e2-8244-80896466f1d8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:21.167864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5db53b1c-31e1-49e2-8244-80896466f1d8 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1265 microversion: 2.1 time: 0.187207 Aug 22 17:38:21.168902 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 481/964] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:20 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:22.190919 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-09aac730-5706-40ef-86b9-c0f77b7d3b9a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:22.191609 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-09aac730-5706-40ef-86b9-c0f77b7d3b9a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:22.194023 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:22.194752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=6 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:22.199954 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09aac730-5706-40ef-86b9-c0f77b7d3b9a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:22.200447 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09aac730-5706-40ef-86b9-c0f77b7d3b9a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:22.206271 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09aac730-5706-40ef-86b9-c0f77b7d3b9a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:22.206271 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09aac730-5706-40ef-86b9-c0f77b7d3b9a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:22.206271 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09aac730-5706-40ef-86b9-c0f77b7d3b9a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:22.206271 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09aac730-5706-40ef-86b9-c0f77b7d3b9a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:22.349235 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-09aac730-5706-40ef-86b9-c0f77b7d3b9a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:22.357949 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-09aac730-5706-40ef-86b9-c0f77b7d3b9a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1265 microversion: 2.1 time: 0.171150 Aug 22 17:38:22.358760 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 484/965] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:22 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:23.381727 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-38bab723-95c3-47a9-9d16-aa637337fef5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:23.382440 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-38bab723-95c3-47a9-9d16-aa637337fef5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:23.385092 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:23.390430 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-38bab723-95c3-47a9-9d16-aa637337fef5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:23.391063 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-38bab723-95c3-47a9-9d16-aa637337fef5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:23.391523 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-38bab723-95c3-47a9-9d16-aa637337fef5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:23.392257 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-38bab723-95c3-47a9-9d16-aa637337fef5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:23.392927 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-38bab723-95c3-47a9-9d16-aa637337fef5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:23.393371 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-38bab723-95c3-47a9-9d16-aa637337fef5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:23.568471 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-38bab723-95c3-47a9-9d16-aa637337fef5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:23.577024 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-38bab723-95c3-47a9-9d16-aa637337fef5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1265 microversion: 2.1 time: 0.199420 Aug 22 17:38:23.578364 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 482/966] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:23 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:24.600915 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-555bfade-8a73-4b09-82c8-4cf53809cff3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:24.601962 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-555bfade-8a73-4b09-82c8-4cf53809cff3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:24.610259 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-555bfade-8a73-4b09-82c8-4cf53809cff3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:24.611092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-555bfade-8a73-4b09-82c8-4cf53809cff3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:24.611925 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-555bfade-8a73-4b09-82c8-4cf53809cff3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:24.612648 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-555bfade-8a73-4b09-82c8-4cf53809cff3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:24.613123 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-555bfade-8a73-4b09-82c8-4cf53809cff3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:24.613845 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-555bfade-8a73-4b09-82c8-4cf53809cff3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:24.842139 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-555bfade-8a73-4b09-82c8-4cf53809cff3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:24.857955 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-555bfade-8a73-4b09-82c8-4cf53809cff3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1265 microversion: 2.1 time: 0.261200 Aug 22 17:38:24.860453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 485/967] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:24 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:25.901752 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-571bda63-3c07-4ada-999f-d360ccd98a2d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:25.902589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-571bda63-3c07-4ada-999f-d360ccd98a2d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:25.909917 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-571bda63-3c07-4ada-999f-d360ccd98a2d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:25.910403 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-571bda63-3c07-4ada-999f-d360ccd98a2d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:25.910866 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-571bda63-3c07-4ada-999f-d360ccd98a2d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:25.911582 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-571bda63-3c07-4ada-999f-d360ccd98a2d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:25.912231 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-571bda63-3c07-4ada-999f-d360ccd98a2d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:25.912660 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-571bda63-3c07-4ada-999f-d360ccd98a2d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:26.064639 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-571bda63-3c07-4ada-999f-d360ccd98a2d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:26.073583 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-571bda63-3c07-4ada-999f-d360ccd98a2d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1265 microversion: 2.1 time: 0.175697 Aug 22 17:38:26.074096 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 483/968] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:25 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:27.110863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f0b4061f-2f86-4bbf-8e90-c86dcb3da769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:27.111915 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f0b4061f-2f86-4bbf-8e90-c86dcb3da769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:27.118876 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0b4061f-2f86-4bbf-8e90-c86dcb3da769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:27.119382 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0b4061f-2f86-4bbf-8e90-c86dcb3da769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:27.119824 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0b4061f-2f86-4bbf-8e90-c86dcb3da769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:27.120542 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0b4061f-2f86-4bbf-8e90-c86dcb3da769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:27.121003 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0b4061f-2f86-4bbf-8e90-c86dcb3da769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:27.121431 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f0b4061f-2f86-4bbf-8e90-c86dcb3da769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:27.272162 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f0b4061f-2f86-4bbf-8e90-c86dcb3da769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:27.287156 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f0b4061f-2f86-4bbf-8e90-c86dcb3da769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1265 microversion: 2.1 time: 0.180121 Aug 22 17:38:27.288148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 486/969] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:27 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:38:28.320105 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c208b604-15c4-4a7e-87a3-9e7d7ad728a3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:28.320750 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c208b604-15c4-4a7e-87a3-9e7d7ad728a3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:28.328304 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c208b604-15c4-4a7e-87a3-9e7d7ad728a3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:28.328935 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c208b604-15c4-4a7e-87a3-9e7d7ad728a3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:28.329385 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c208b604-15c4-4a7e-87a3-9e7d7ad728a3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:28.330118 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c208b604-15c4-4a7e-87a3-9e7d7ad728a3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:28.330613 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c208b604-15c4-4a7e-87a3-9e7d7ad728a3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:28.331042 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c208b604-15c4-4a7e-87a3-9e7d7ad728a3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:28.526387 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c208b604-15c4-4a7e-87a3-9e7d7ad728a3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:28.534931 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c208b604-15c4-4a7e-87a3-9e7d7ad728a3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1265 microversion: 2.1 time: 0.218857 Aug 22 17:38:28.535526 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 484/970] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:28 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:28.967790 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-9f097a55-9f18-413f-adfd-63b1645e9b12 req-07f62cbd-086b-4f96-a847-4cb977b6b505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa975518-469e-47f3-8165-113b27287104", "name": "network-vif-plugged", "status": "completed", "tag": "20bb2f1b-c55a-4870-b4f7-4b9ad51f76f3"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:38:28.979154 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9f097a55-9f18-413f-adfd-63b1645e9b12 req-07f62cbd-086b-4f96-a847-4cb977b6b505 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:28.979807 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9f097a55-9f18-413f-adfd-63b1645e9b12 req-07f62cbd-086b-4f96-a847-4cb977b6b505 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:28.980296 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9f097a55-9f18-413f-adfd-63b1645e9b12 req-07f62cbd-086b-4f96-a847-4cb977b6b505 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:28.993343 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-9f097a55-9f18-413f-adfd-63b1645e9b12 req-07f62cbd-086b-4f96-a847-4cb977b6b505 service nova] Creating event network-vif-plugged:20bb2f1b-c55a-4870-b4f7-4b9ad51f76f3 for instance fa975518-469e-47f3-8165-113b27287104 on hv-cinder-85394 Aug 22 17:38:29.000787 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-9f097a55-9f18-413f-adfd-63b1645e9b12 req-07f62cbd-086b-4f96-a847-4cb977b6b505 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101913 Aug 22 17:38:29.001893 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 487/971] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:38:29.556493 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5514daa1-3c19-440d-baf0-23f9634efa79 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:29.557278 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5514daa1-3c19-440d-baf0-23f9634efa79 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:29.564593 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5514daa1-3c19-440d-baf0-23f9634efa79 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:29.565085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5514daa1-3c19-440d-baf0-23f9634efa79 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:29.565516 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5514daa1-3c19-440d-baf0-23f9634efa79 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:29.566218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5514daa1-3c19-440d-baf0-23f9634efa79 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:29.566709 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5514daa1-3c19-440d-baf0-23f9634efa79 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:29.567130 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5514daa1-3c19-440d-baf0-23f9634efa79 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:29.723816 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5514daa1-3c19-440d-baf0-23f9634efa79 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:29.732358 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5514daa1-3c19-440d-baf0-23f9634efa79 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1265 microversion: 2.1 time: 0.179840 Aug 22 17:38:29.733622 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 485/972] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:29 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:30.757780 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-41617e46-1de3-4c23-b1fe-799c7424c5f9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:30.758724 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-41617e46-1de3-4c23-b1fe-799c7424c5f9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:30.768932 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-41617e46-1de3-4c23-b1fe-799c7424c5f9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:30.769755 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-41617e46-1de3-4c23-b1fe-799c7424c5f9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:30.770306 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-41617e46-1de3-4c23-b1fe-799c7424c5f9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:30.772113 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-41617e46-1de3-4c23-b1fe-799c7424c5f9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:30.772714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-41617e46-1de3-4c23-b1fe-799c7424c5f9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:30.773240 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-41617e46-1de3-4c23-b1fe-799c7424c5f9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:30.945063 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-41617e46-1de3-4c23-b1fe-799c7424c5f9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:30.954944 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-41617e46-1de3-4c23-b1fe-799c7424c5f9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1265 microversion: 2.1 time: 0.203421 Aug 22 17:38:30.955619 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 488/973] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:30 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:31.977661 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2dca7a0f-a9fe-41d3-831b-dcd61a7b6738 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:31.978307 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2dca7a0f-a9fe-41d3-831b-dcd61a7b6738 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:31.993646 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2dca7a0f-a9fe-41d3-831b-dcd61a7b6738 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:31.994159 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2dca7a0f-a9fe-41d3-831b-dcd61a7b6738 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:31.994649 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2dca7a0f-a9fe-41d3-831b-dcd61a7b6738 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:31.995420 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2dca7a0f-a9fe-41d3-831b-dcd61a7b6738 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:31.995898 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2dca7a0f-a9fe-41d3-831b-dcd61a7b6738 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:31.996337 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2dca7a0f-a9fe-41d3-831b-dcd61a7b6738 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:32.152029 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2dca7a0f-a9fe-41d3-831b-dcd61a7b6738 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:32.161671 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2dca7a0f-a9fe-41d3-831b-dcd61a7b6738 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1451 microversion: 2.1 time: 0.188077 Aug 22 17:38:32.162264 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 486/974] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:31 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1451 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:32.183879 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f8de235f-b675-41ed-9e99-f610419ce305 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:32.184622 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f8de235f-b675-41ed-9e99-f610419ce305 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:32.192497 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f8de235f-b675-41ed-9e99-f610419ce305 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:32.193007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f8de235f-b675-41ed-9e99-f610419ce305 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:32.193547 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f8de235f-b675-41ed-9e99-f610419ce305 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:32.194306 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f8de235f-b675-41ed-9e99-f610419ce305 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:32.194815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f8de235f-b675-41ed-9e99-f610419ce305 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:32.195249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f8de235f-b675-41ed-9e99-f610419ce305 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:32.353145 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f8de235f-b675-41ed-9e99-f610419ce305 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:38:32.363717 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f8de235f-b675-41ed-9e99-f610419ce305 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1451 microversion: 2.1 time: 0.184020 Aug 22 17:38:32.364322 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 489/975] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:38:32 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1451 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:38:35.376786 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-50b5c5f1-7c6f-4522-b191-1320c063e706 req-5bd052c9-3caa-4d8b-90be-ae59045ed680 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa975518-469e-47f3-8165-113b27287104", "tag": "20bb2f1b-c55a-4870-b4f7-4b9ad51f76f3"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:38:35.394205 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-50b5c5f1-7c6f-4522-b191-1320c063e706 req-5bd052c9-3caa-4d8b-90be-ae59045ed680 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:35.395095 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-50b5c5f1-7c6f-4522-b191-1320c063e706 req-5bd052c9-3caa-4d8b-90be-ae59045ed680 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:35.395877 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-50b5c5f1-7c6f-4522-b191-1320c063e706 req-5bd052c9-3caa-4d8b-90be-ae59045ed680 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:35.423651 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-50b5c5f1-7c6f-4522-b191-1320c063e706 req-5bd052c9-3caa-4d8b-90be-ae59045ed680 service nova] Creating event network-changed:20bb2f1b-c55a-4870-b4f7-4b9ad51f76f3 for instance fa975518-469e-47f3-8165-113b27287104 on hv-cinder-85394 Aug 22 17:38:35.432995 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-50b5c5f1-7c6f-4522-b191-1320c063e706 req-5bd052c9-3caa-4d8b-90be-ae59045ed680 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.163378 Aug 22 17:38:35.434105 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 487/976] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:38:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:38:48.525494 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8591321c-3650-4db4-b71d-6d6e44002b41 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:38:48.526212 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8591321c-3650-4db4-b71d-6d6e44002b41 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:48.528660 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:48.529997 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=76 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:48.535759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8591321c-3650-4db4-b71d-6d6e44002b41 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:48.545917 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8591321c-3650-4db4-b71d-6d6e44002b41 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:48.545917 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8591321c-3650-4db4-b71d-6d6e44002b41 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:48.545917 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8591321c-3650-4db4-b71d-6d6e44002b41 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:48.545917 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8591321c-3650-4db4-b71d-6d6e44002b41 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:48.546816 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8591321c-3650-4db4-b71d-6d6e44002b41 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:48.565672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8591321c-3650-4db4-b71d-6d6e44002b41 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/ips" status: 200 len: 149 microversion: 2.1 time: 0.044229 Aug 22 17:38:48.566269 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 490/977] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 22 17:38:48 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:38:51.755594 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:51.756755 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:38:51.761820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4cbb12f2-f86e-46a3-86f0-117a989b7e40 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "baac1ea3-8b1c-4911-a307-b58f9ba2ba35"}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:38:51.764932 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4cbb12f2-f86e-46a3-86f0-117a989b7e40 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:38:51.771679 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4cbb12f2-f86e-46a3-86f0-117a989b7e40 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:51.772224 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4cbb12f2-f86e-46a3-86f0-117a989b7e40 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:51.772657 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4cbb12f2-f86e-46a3-86f0-117a989b7e40 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:51.773358 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4cbb12f2-f86e-46a3-86f0-117a989b7e40 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:38:51.773807 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4cbb12f2-f86e-46a3-86f0-117a989b7e40 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:38:51.774228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4cbb12f2-f86e-46a3-86f0-117a989b7e40 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:38:52.675950 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4cbb12f2-f86e-46a3-86f0-117a989b7e40 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "POST /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.921799 Aug 22 17:38:52.676758 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 488/978] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 22 17:38:51 2022] POST /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/os-volume_attachments => generated 194 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:39:01.084561 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-eaf8472c-f231-4072-a2cd-8a3f025a6501 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:01.086935 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-eaf8472c-f231-4072-a2cd-8a3f025a6501 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:01.095341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eaf8472c-f231-4072-a2cd-8a3f025a6501 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:01.095833 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eaf8472c-f231-4072-a2cd-8a3f025a6501 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:01.096271 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eaf8472c-f231-4072-a2cd-8a3f025a6501 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:01.097013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eaf8472c-f231-4072-a2cd-8a3f025a6501 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:01.097465 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eaf8472c-f231-4072-a2cd-8a3f025a6501 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:01.097925 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-eaf8472c-f231-4072-a2cd-8a3f025a6501 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:01.133139 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-eaf8472c-f231-4072-a2cd-8a3f025a6501 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052222 Aug 22 17:39:01.134161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 491/979] 10.222.0.20 () {60 vars in 1343 bytes} [Mon Aug 22 17:39:01 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:39:01.218687 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-49114d0f-274c-4093-ac65-987b6862bbe6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:01.219290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-49114d0f-274c-4093-ac65-987b6862bbe6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:01.226518 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-49114d0f-274c-4093-ac65-987b6862bbe6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:01.227430 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-49114d0f-274c-4093-ac65-987b6862bbe6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:01.228069 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-49114d0f-274c-4093-ac65-987b6862bbe6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:01.228916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-49114d0f-274c-4093-ac65-987b6862bbe6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:01.229380 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-49114d0f-274c-4093-ac65-987b6862bbe6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:01.229796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-49114d0f-274c-4093-ac65-987b6862bbe6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:01.260651 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-49114d0f-274c-4093-ac65-987b6862bbe6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Going to try to terminate instance {{(pid=121853) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:39:01.463335 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-207591c7-abb3-41f3-b4fa-1952ec847dfb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:01.463825 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-207591c7-abb3-41f3-b4fa-1952ec847dfb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:01.470131 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-207591c7-abb3-41f3-b4fa-1952ec847dfb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:01.470755 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-207591c7-abb3-41f3-b4fa-1952ec847dfb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:01.471267 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-207591c7-abb3-41f3-b4fa-1952ec847dfb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:01.472040 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-207591c7-abb3-41f3-b4fa-1952ec847dfb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:01.472546 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-207591c7-abb3-41f3-b4fa-1952ec847dfb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:01.473020 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-207591c7-abb3-41f3-b4fa-1952ec847dfb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:01.589608 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-207591c7-abb3-41f3-b4fa-1952ec847dfb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lazy-loading 'services' on Instance uuid 807e63ee-52a6-4bcc-bc90-d492fff06ad6 {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:39:01.647863 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-49114d0f-274c-4093-ac65-987b6862bbe6 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 204 len: 0 microversion: 2.20 time: 0.434491 Aug 22 17:39:01.649669 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 489/980] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 22 17:39:01 2022] DELETE /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 0 bytes in 436 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:39:01.658781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-7cbd0345-06c1-4eeb-8d3a-03129c6d7f52 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:01.659483 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-7cbd0345-06c1-4eeb-8d3a-03129c6d7f52 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:01.665970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7cbd0345-06c1-4eeb-8d3a-03129c6d7f52 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:01.666442 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7cbd0345-06c1-4eeb-8d3a-03129c6d7f52 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:01.666907 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7cbd0345-06c1-4eeb-8d3a-03129c6d7f52 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:01.667613 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7cbd0345-06c1-4eeb-8d3a-03129c6d7f52 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:01.668049 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7cbd0345-06c1-4eeb-8d3a-03129c6d7f52 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:01.668467 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7cbd0345-06c1-4eeb-8d3a-03129c6d7f52 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:01.820324 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7cbd0345-06c1-4eeb-8d3a-03129c6d7f52 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:01.830203 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7cbd0345-06c1-4eeb-8d3a-03129c6d7f52 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:01.831747 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7cbd0345-06c1-4eeb-8d3a-03129c6d7f52 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:01.832951 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-7cbd0345-06c1-4eeb-8d3a-03129c6d7f52 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1721 microversion: 2.20 time: 0.179375 Aug 22 17:39:01.833571 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 490/981] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:39:01 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1721 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:39:01.892439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-207591c7-abb3-41f3-b4fa-1952ec847dfb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/os-volume_attachments/baac1ea3-8b1c-4911-a307-b58f9ba2ba35" status: 202 len: 0 microversion: 2.1 time: 0.433038 Aug 22 17:39:01.893046 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 492/982] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 22 17:39:01 2022] DELETE /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/os-volume_attachments/baac1ea3-8b1c-4911-a307-b58f9ba2ba35 => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:39:01.907959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4abb5f15-2fb5-442c-8a31-5e69d4b654cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:01.912347 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4abb5f15-2fb5-442c-8a31-5e69d4b654cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:01.924428 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4abb5f15-2fb5-442c-8a31-5e69d4b654cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:01.925121 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4abb5f15-2fb5-442c-8a31-5e69d4b654cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:01.933571 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4abb5f15-2fb5-442c-8a31-5e69d4b654cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:01.933571 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4abb5f15-2fb5-442c-8a31-5e69d4b654cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:01.933571 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4abb5f15-2fb5-442c-8a31-5e69d4b654cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:01.933571 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4abb5f15-2fb5-442c-8a31-5e69d4b654cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:01.987695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4abb5f15-2fb5-442c-8a31-5e69d4b654cc tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088942 Aug 22 17:39:01.988344 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 491/983] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:39:01 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:39:02.858670 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-7379abc0-90bb-43a5-971a-74128c3b1b29 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:02.859389 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-7379abc0-90bb-43a5-971a-74128c3b1b29 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:02.866108 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7379abc0-90bb-43a5-971a-74128c3b1b29 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:02.866634 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7379abc0-90bb-43a5-971a-74128c3b1b29 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:02.867076 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7379abc0-90bb-43a5-971a-74128c3b1b29 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:02.867859 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7379abc0-90bb-43a5-971a-74128c3b1b29 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:02.868326 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7379abc0-90bb-43a5-971a-74128c3b1b29 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:02.868815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7379abc0-90bb-43a5-971a-74128c3b1b29 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:03.002166 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6a0db582-23e1-4e32-a3bf-d65f8f0a84f5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:03.004885 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6a0db582-23e1-4e32-a3bf-d65f8f0a84f5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:03.012119 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a0db582-23e1-4e32-a3bf-d65f8f0a84f5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:03.012633 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a0db582-23e1-4e32-a3bf-d65f8f0a84f5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:03.013243 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a0db582-23e1-4e32-a3bf-d65f8f0a84f5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:03.014175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a0db582-23e1-4e32-a3bf-d65f8f0a84f5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:03.014661 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a0db582-23e1-4e32-a3bf-d65f8f0a84f5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:03.015086 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a0db582-23e1-4e32-a3bf-d65f8f0a84f5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:03.045626 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-7379abc0-90bb-43a5-971a-74128c3b1b29 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:03.053307 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6a0db582-23e1-4e32-a3bf-d65f8f0a84f5 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056454 Aug 22 17:39:03.058864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 492/984] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:39:02 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:39:03.059127 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-7379abc0-90bb-43a5-971a-74128c3b1b29 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:03.059127 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-7379abc0-90bb-43a5-971a-74128c3b1b29 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:03.061006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-7379abc0-90bb-43a5-971a-74128c3b1b29 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1721 microversion: 2.20 time: 0.206666 Aug 22 17:39:03.061517 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 493/985] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:39:02 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:39:04.069962 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0ff80f9f-3161-4079-b286-a4092470e4ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:04.073048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0ff80f9f-3161-4079-b286-a4092470e4ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:04.080888 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ff80f9f-3161-4079-b286-a4092470e4ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:04.081526 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ff80f9f-3161-4079-b286-a4092470e4ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:04.081980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ff80f9f-3161-4079-b286-a4092470e4ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:04.087277 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ff80f9f-3161-4079-b286-a4092470e4ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:04.087277 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ff80f9f-3161-4079-b286-a4092470e4ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:04.087277 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ff80f9f-3161-4079-b286-a4092470e4ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:04.089723 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-cf8aaf70-e632-4c7e-9a28-3ccbb4808ff9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:04.090861 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-cf8aaf70-e632-4c7e-9a28-3ccbb4808ff9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:04.100154 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cf8aaf70-e632-4c7e-9a28-3ccbb4808ff9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:04.100902 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cf8aaf70-e632-4c7e-9a28-3ccbb4808ff9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:04.101681 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cf8aaf70-e632-4c7e-9a28-3ccbb4808ff9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:04.102987 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cf8aaf70-e632-4c7e-9a28-3ccbb4808ff9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:04.103700 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cf8aaf70-e632-4c7e-9a28-3ccbb4808ff9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:04.104194 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-cf8aaf70-e632-4c7e-9a28-3ccbb4808ff9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:04.125285 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0ff80f9f-3161-4079-b286-a4092470e4ed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061336 Aug 22 17:39:04.130508 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 493/986] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:39:04 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:39:04.242572 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-cf8aaf70-e632-4c7e-9a28-3ccbb4808ff9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:04.253447 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-cf8aaf70-e632-4c7e-9a28-3ccbb4808ff9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:04.255043 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-cf8aaf70-e632-4c7e-9a28-3ccbb4808ff9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:04.256548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-cf8aaf70-e632-4c7e-9a28-3ccbb4808ff9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1654 microversion: 2.20 time: 0.173819 Aug 22 17:39:04.257187 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 494/987] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:39:04 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1654 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 22 17:39:04.555385 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-4efed5ac-7580-45dd-891b-2cd76a9ad857 req-0a2a745d-8c55-408a-9411-12c2f1741e4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01a67bb4-4540-4e14-a7bc-74bf8ca080da", "name": "network-vif-deleted", "tag": "c93f66cf-3a0a-41e2-a4a1-03d394f2cce2"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:39:04.577211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-4efed5ac-7580-45dd-891b-2cd76a9ad857 req-0a2a745d-8c55-408a-9411-12c2f1741e4b service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:04.578525 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-4efed5ac-7580-45dd-891b-2cd76a9ad857 req-0a2a745d-8c55-408a-9411-12c2f1741e4b service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:04.579595 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-4efed5ac-7580-45dd-891b-2cd76a9ad857 req-0a2a745d-8c55-408a-9411-12c2f1741e4b service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:04.601680 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-4efed5ac-7580-45dd-891b-2cd76a9ad857 req-0a2a745d-8c55-408a-9411-12c2f1741e4b service nova] Creating event network-vif-deleted:c93f66cf-3a0a-41e2-a4a1-03d394f2cce2 for instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da on hv-cinder-85394 Aug 22 17:39:04.611339 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-4efed5ac-7580-45dd-891b-2cd76a9ad857 req-0a2a745d-8c55-408a-9411-12c2f1741e4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062485 Aug 22 17:39:04.612853 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 494/988] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:39:05.139687 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-09146f03-53a6-447f-b813-d91e5727abc4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:05.142175 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-09146f03-53a6-447f-b813-d91e5727abc4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:05.149917 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09146f03-53a6-447f-b813-d91e5727abc4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:05.150411 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09146f03-53a6-447f-b813-d91e5727abc4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:05.150890 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09146f03-53a6-447f-b813-d91e5727abc4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:05.151611 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09146f03-53a6-447f-b813-d91e5727abc4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:05.152066 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09146f03-53a6-447f-b813-d91e5727abc4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:05.152492 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-09146f03-53a6-447f-b813-d91e5727abc4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:05.197214 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-09146f03-53a6-447f-b813-d91e5727abc4 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063073 Aug 22 17:39:05.197815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 495/989] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:39:05 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:39:05.281599 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:05.282308 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:05.285091 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3b8868d8-a4e7-4562-8815-36c8914e7a53 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:05.286350 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3b8868d8-a4e7-4562-8815-36c8914e7a53 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:05.290129 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:05.290969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:05.291611 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:05.292558 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:05.293234 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:05.293940 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:05.298314 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3b8868d8-a4e7-4562-8815-36c8914e7a53 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:05.299185 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3b8868d8-a4e7-4562-8815-36c8914e7a53 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:05.299967 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3b8868d8-a4e7-4562-8815-36c8914e7a53 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:05.302051 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3b8868d8-a4e7-4562-8815-36c8914e7a53 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:05.302788 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3b8868d8-a4e7-4562-8815-36c8914e7a53 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:05.303609 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3b8868d8-a4e7-4562-8815-36c8914e7a53 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:05.331555 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:05.332177 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:05.332695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:05.333654 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lazy-loading 'fault' on Instance uuid 01a67bb4-4540-4e14-a7bc-74bf8ca080da {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:39:05.358197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3b8868d8-a4e7-4562-8815-36c8914e7a53 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Going to try to terminate instance {{(pid=121852) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:39:05.441256 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:05.441256 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:05.441716 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '864d7f47381e4e4498ad110dbfcfc154', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c20e7f3aca4c49ae84390a3f1a8ce410', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:05.441716 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2436f290-ee2a-4d5e-9ac7-f7037daec9a9 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 200 len: 1370 microversion: 2.20 time: 0.162487 Aug 22 17:39:05.441716 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 495/990] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:39:05 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 22 17:39:05.865609 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3b8868d8-a4e7-4562-8815-36c8914e7a53 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 204 len: 0 microversion: 2.1 time: 0.588179 Aug 22 17:39:05.866603 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 496/991] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:39:05 2022] DELETE /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:39:05.876629 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-82a5874a-1dde-4be2-ad58-66d3f01e08fb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:05.877538 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-82a5874a-1dde-4be2-ad58-66d3f01e08fb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:05.885718 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-82a5874a-1dde-4be2-ad58-66d3f01e08fb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:05.886267 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-82a5874a-1dde-4be2-ad58-66d3f01e08fb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:05.886799 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-82a5874a-1dde-4be2-ad58-66d3f01e08fb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:05.888450 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-82a5874a-1dde-4be2-ad58-66d3f01e08fb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:05.889061 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-82a5874a-1dde-4be2-ad58-66d3f01e08fb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:05.889675 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-82a5874a-1dde-4be2-ad58-66d3f01e08fb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:06.075642 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-82a5874a-1dde-4be2-ad58-66d3f01e08fb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:06.083584 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-82a5874a-1dde-4be2-ad58-66d3f01e08fb tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1680 microversion: 2.1 time: 0.211991 Aug 22 17:39:06.084182 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 496/992] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:05 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1680 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:39:06.464241 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a9414dfc-0545-435d-a72d-87c71033a3e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:06.464938 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a9414dfc-0545-435d-a72d-87c71033a3e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:06.473062 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9414dfc-0545-435d-a72d-87c71033a3e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:06.473521 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9414dfc-0545-435d-a72d-87c71033a3e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:06.473978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9414dfc-0545-435d-a72d-87c71033a3e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:06.474730 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9414dfc-0545-435d-a72d-87c71033a3e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:06.475204 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9414dfc-0545-435d-a72d-87c71033a3e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:06.475651 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a9414dfc-0545-435d-a72d-87c71033a3e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:06.493689 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-a9414dfc-0545-435d-a72d-87c71033a3e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] HTTP exception thrown: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a9414dfc-0545-435d-a72d-87c71033a3e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Request method failure captured: Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da HTTP/1.1 Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xUtP-ikb0eO8-L8wa1U9tVnibx7-nGJqwmYbXf2MT1WxarA_36bruP5z3HPY_iasZlQTJej7wleO02jFCwb31Ht2XNYuRcgJ5iVmm2myKTiDU_0uj66-YheAnyu-sa6ej5AyWkMhn9WxiOxjxiMxJuc-CjWVB0slYCz2QJM91qf98 Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: c20e7f3aca4c49ae84390a3f1a8ce410 Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:39:06.495543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:39:06.499424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c20e7f3aca4c49ae84390a3f1a8ce410", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:39:06.499424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:06.499424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: c20e7f3aca4c49ae84390a3f1a8ce410 Aug 22 17:39:06.499424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:06.499424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeShelveTestJSON-830857878-project Aug 22 17:39:06.499424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:39:06.499424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:39:06.499424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 864d7f47381e4e4498ad110dbfcfc154 Aug 22 17:39:06.499424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeShelveTestJSON-830857878-project Aug 22 17:39:06.499424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:39:06.499424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:06.499424 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '01a67bb4-4540-4e14-a7bc-74bf8ca080da'} Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:06.501249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:06.503725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:06.505456 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a9414dfc-0545-435d-a72d-87c71033a3e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Returning 404 to user: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:06.505456 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a9414dfc-0545-435d-a72d-87c71033a3e5 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 404 len: 111 microversion: 2.20 time: 0.037005 Aug 22 17:39:06.505456 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 497/993] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:39:06 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 22 17:39:06.510537 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ef38f4b9-e389-4bf2-ae15-e5697cd6c151 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '.version_select at 0x7f0e5c5c7160>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:06.700694 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ef38f4b9-e389-4bf2-ae15-e5697cd6c151 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-891569955" status: 204 len: 0 microversion: 2.20 time: 0.196668 Aug 22 17:39:06.701429 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 497/994] 10.222.0.20 () {60 vars in 1259 bytes} [Mon Aug 22 17:39:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-891569955 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 22 17:39:07.106593 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e739e13c-1d07-4b84-97fb-f983e31f8ec9 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:07.107521 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e739e13c-1d07-4b84-97fb-f983e31f8ec9 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:07.115902 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e739e13c-1d07-4b84-97fb-f983e31f8ec9 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:07.116617 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e739e13c-1d07-4b84-97fb-f983e31f8ec9 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:07.117159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e739e13c-1d07-4b84-97fb-f983e31f8ec9 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:07.118259 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e739e13c-1d07-4b84-97fb-f983e31f8ec9 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:07.119121 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e739e13c-1d07-4b84-97fb-f983e31f8ec9 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:07.119699 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e739e13c-1d07-4b84-97fb-f983e31f8ec9 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:07.415699 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e739e13c-1d07-4b84-97fb-f983e31f8ec9 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:07.427451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e739e13c-1d07-4b84-97fb-f983e31f8ec9 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1680 microversion: 2.1 time: 0.325434 Aug 22 17:39:07.428247 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 498/995] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:07 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1680 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:08.452874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1c2a9881-f304-4043-a96b-606988f2a50a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:08.453927 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1c2a9881-f304-4043-a96b-606988f2a50a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:08.462820 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1c2a9881-f304-4043-a96b-606988f2a50a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:08.463475 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1c2a9881-f304-4043-a96b-606988f2a50a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:08.464043 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1c2a9881-f304-4043-a96b-606988f2a50a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:08.464921 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1c2a9881-f304-4043-a96b-606988f2a50a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:08.465610 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1c2a9881-f304-4043-a96b-606988f2a50a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:08.466171 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1c2a9881-f304-4043-a96b-606988f2a50a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:08.630366 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1c2a9881-f304-4043-a96b-606988f2a50a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:08.642564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1c2a9881-f304-4043-a96b-606988f2a50a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1680 microversion: 2.1 time: 0.196285 Aug 22 17:39:08.654169 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 498/996] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:08 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:08.977479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-f389b8e7-262b-470e-9b8d-7df795dcc8fe req-92a77172-f037-4e9a-9292-76b08a936243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "807e63ee-52a6-4bcc-bc90-d492fff06ad6", "name": "network-vif-deleted", "tag": "fe1e7627-2a87-4924-873f-5bc0f6035f49"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:39:08.994858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-f389b8e7-262b-470e-9b8d-7df795dcc8fe req-92a77172-f037-4e9a-9292-76b08a936243 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:08.994858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-f389b8e7-262b-470e-9b8d-7df795dcc8fe req-92a77172-f037-4e9a-9292-76b08a936243 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:08.994858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-f389b8e7-262b-470e-9b8d-7df795dcc8fe req-92a77172-f037-4e9a-9292-76b08a936243 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:09.007142 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-f389b8e7-262b-470e-9b8d-7df795dcc8fe req-92a77172-f037-4e9a-9292-76b08a936243 service nova] Creating event network-vif-deleted:fe1e7627-2a87-4924-873f-5bc0f6035f49 for instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 on hv-cinder-85394 Aug 22 17:39:09.013747 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-f389b8e7-262b-470e-9b8d-7df795dcc8fe req-92a77172-f037-4e9a-9292-76b08a936243 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039923 Aug 22 17:39:09.014855 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 499/997] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:39:09.109295 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1ca4b0f2-cf48-41a0-977b-ce44884810f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:09.110197 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1ca4b0f2-cf48-41a0-977b-ce44884810f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:09.121406 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ca4b0f2-cf48-41a0-977b-ce44884810f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:09.122978 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ca4b0f2-cf48-41a0-977b-ce44884810f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:09.124095 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ca4b0f2-cf48-41a0-977b-ce44884810f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:09.125414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ca4b0f2-cf48-41a0-977b-ce44884810f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:09.126434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ca4b0f2-cf48-41a0-977b-ce44884810f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:09.127468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ca4b0f2-cf48-41a0-977b-ce44884810f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:09.155514 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-1ca4b0f2-cf48-41a0-977b-ce44884810f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] HTTP exception thrown: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1ca4b0f2-cf48-41a0-977b-ce44884810f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Request method failure captured: Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: DELETE /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da HTTP/1.1 Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA7xUtP-ikb0eO8-L8wa1U9tVnibx7-nGJqwmYbXf2MT1WxarA_36bruP5z3HPY_iasZlQTJej7wleO02jFCwb31Ht2XNYuRcgJ5iVmm2myKTiDU_0uj66-YheAnyu-sa6ej5AyWkMhn9WxiOxjxiMxJuc-CjWVB0slYCz2QJM91qf98 Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: c20e7f3aca4c49ae84390a3f1a8ce410 Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:39:09.157733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:39:09.165058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c20e7f3aca4c49ae84390a3f1a8ce410", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:39:09.165058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:09.165058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: c20e7f3aca4c49ae84390a3f1a8ce410 Aug 22 17:39:09.165058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:09.165058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-AttachVolumeShelveTestJSON-830857878-project Aug 22 17:39:09.165058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:39:09.165058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:39:09.165058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: 864d7f47381e4e4498ad110dbfcfc154 Aug 22 17:39:09.165058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-AttachVolumeShelveTestJSON-830857878-project Aug 22 17:39:09.165058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:39:09.165058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:09.165058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': '01a67bb4-4540-4e14-a7bc-74bf8ca080da'} Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:09.165910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:09.167312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:09.169346 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1ca4b0f2-cf48-41a0-977b-ce44884810f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Returning 404 to user: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:09.169346 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1ca4b0f2-cf48-41a0-977b-ce44884810f7 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 404 len: 111 microversion: 2.20 time: 0.058827 Aug 22 17:39:09.169346 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 499/998] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 22 17:39:09 2022] DELETE /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:39:09.170627 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-129479e6-7320-4a38-bfa6-b29331d274d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:09.171352 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-129479e6-7320-4a38-bfa6-b29331d274d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: 01a67bb4-4540-4e14-a7bc-74bf8ca080da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:09.178768 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-129479e6-7320-4a38-bfa6-b29331d274d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:09.179448 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-129479e6-7320-4a38-bfa6-b29331d274d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:09.180545 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-129479e6-7320-4a38-bfa6-b29331d274d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:09.180728 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-129479e6-7320-4a38-bfa6-b29331d274d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:09.181326 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-129479e6-7320-4a38-bfa6-b29331d274d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:09.181760 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-129479e6-7320-4a38-bfa6-b29331d274d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:09.205482 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-129479e6-7320-4a38-bfa6-b29331d274d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] HTTP exception thrown: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-129479e6-7320-4a38-bfa6-b29331d274d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Request method failure captured: Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da HTTP/1.1 Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xUtP-ikb0eO8-L8wa1U9tVnibx7-nGJqwmYbXf2MT1WxarA_36bruP5z3HPY_iasZlQTJej7wleO02jFCwb31Ht2XNYuRcgJ5iVmm2myKTiDU_0uj66-YheAnyu-sa6ej5AyWkMhn9WxiOxjxiMxJuc-CjWVB0slYCz2QJM91qf98 Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: c20e7f3aca4c49ae84390a3f1a8ce410 Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:39:09.209360 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:39:09.212218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c20e7f3aca4c49ae84390a3f1a8ce410", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:39:09.212218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:09.212218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: c20e7f3aca4c49ae84390a3f1a8ce410 Aug 22 17:39:09.212218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:09.212218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeShelveTestJSON-830857878-project Aug 22 17:39:09.212218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:39:09.212218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:39:09.212218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 864d7f47381e4e4498ad110dbfcfc154 Aug 22 17:39:09.212218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeShelveTestJSON-830857878-project Aug 22 17:39:09.212218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:39:09.212218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:09.212218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '01a67bb4-4540-4e14-a7bc-74bf8ca080da'} Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:09.213458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. Aug 22 17:39:09.217453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:09.222390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-129479e6-7320-4a38-bfa6-b29331d274d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Returning 404 to user: Instance 01a67bb4-4540-4e14-a7bc-74bf8ca080da could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:09.222390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-129479e6-7320-4a38-bfa6-b29331d274d4 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da" status: 404 len: 111 microversion: 2.20 time: 0.045700 Aug 22 17:39:09.222390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 500/999] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:39:09 2022] GET /compute/v2.1/servers/01a67bb4-4540-4e14-a7bc-74bf8ca080da => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:39:09.688889 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-96c489f1-8603-4f2e-9d10-376755aa4b95 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:09.689981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-96c489f1-8603-4f2e-9d10-376755aa4b95 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:09.711153 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96c489f1-8603-4f2e-9d10-376755aa4b95 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:09.712017 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96c489f1-8603-4f2e-9d10-376755aa4b95 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:09.712782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96c489f1-8603-4f2e-9d10-376755aa4b95 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:09.713927 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96c489f1-8603-4f2e-9d10-376755aa4b95 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:09.714440 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96c489f1-8603-4f2e-9d10-376755aa4b95 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:09.714965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96c489f1-8603-4f2e-9d10-376755aa4b95 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:09.750617 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96c489f1-8603-4f2e-9d10-376755aa4b95 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:09.751102 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96c489f1-8603-4f2e-9d10-376755aa4b95 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:09.751542 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-96c489f1-8603-4f2e-9d10-376755aa4b95 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:09.753099 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-96c489f1-8603-4f2e-9d10-376755aa4b95 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lazy-loading 'fault' on Instance uuid 807e63ee-52a6-4bcc-bc90-d492fff06ad6 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:39:09.797486 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-96c489f1-8603-4f2e-9d10-376755aa4b95 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0db362075b04b2294a6268576a5bba3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6436020e938047408d1f979e23dd48da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:09.806198 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-96c489f1-8603-4f2e-9d10-376755aa4b95 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 200 len: 1331 microversion: 2.1 time: 0.141933 Aug 22 17:39:09.806829 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 500/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:09 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 1331 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:10.564040 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a883202f-f99f-4212-a236-75240b96f240 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:10.564040 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a883202f-f99f-4212-a236-75240b96f240 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:10.567543 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a883202f-f99f-4212-a236-75240b96f240 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:10.568118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a883202f-f99f-4212-a236-75240b96f240 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:10.568493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a883202f-f99f-4212-a236-75240b96f240 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:10.569207 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a883202f-f99f-4212-a236-75240b96f240 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:10.569887 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a883202f-f99f-4212-a236-75240b96f240 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:10.570143 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a883202f-f99f-4212-a236-75240b96f240 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:10.586398 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-a883202f-f99f-4212-a236-75240b96f240 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] HTTP exception thrown: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a883202f-f99f-4212-a236-75240b96f240 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Request method failure captured: Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: DELETE /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 HTTP/1.1 Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xUtP-ikb0eO8-L8wa1U9tVnibx7-nGJqwmYbXf2MT1WxarA_36bruP5z3HPY_iasZlQTJej7wleO02jFCwb31Ht2XNYuRcgJ5iVmm2myKTiDU_0uj66-YheAnyu-sa6ej5AyWkMhn9WxiOxjxiMxJuc-CjWVB0slYCz2QJM91qf98 Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: c20e7f3aca4c49ae84390a3f1a8ce410 Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:39:10.588019 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:39:10.590092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c20e7f3aca4c49ae84390a3f1a8ce410", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:39:10.590092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:10.590092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: c20e7f3aca4c49ae84390a3f1a8ce410 Aug 22 17:39:10.590092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:10.590092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeShelveTestJSON-830857878-project Aug 22 17:39:10.590092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:39:10.590092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:39:10.590092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 864d7f47381e4e4498ad110dbfcfc154 Aug 22 17:39:10.590092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeShelveTestJSON-830857878-project Aug 22 17:39:10.590092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:39:10.590092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:39:10.590092 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': 'fcb3959b-fd48-4a97-81d0-5b74ec4cfd32'} Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:10.592379 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:39:10.593951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.595472 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a883202f-f99f-4212-a236-75240b96f240 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Returning 404 to user: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:10.595472 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a883202f-f99f-4212-a236-75240b96f240 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 404 len: 111 microversion: 2.20 time: 0.034771 Aug 22 17:39:10.595472 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 501/1001] 10.222.0.20 () {60 vars in 1280 bytes} [Mon Aug 22 17:39:10 2022] DELETE /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:39:10.598929 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-86157511-1980-4cba-9c27-c2795556af75 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:10.599536 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-86157511-1980-4cba-9c27-c2795556af75 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] [instance: fcb3959b-fd48-4a97-81d0-5b74ec4cfd32] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:10.605444 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-86157511-1980-4cba-9c27-c2795556af75 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:10.605930 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-86157511-1980-4cba-9c27-c2795556af75 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:10.607096 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-86157511-1980-4cba-9c27-c2795556af75 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:10.607828 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-86157511-1980-4cba-9c27-c2795556af75 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:10.608294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-86157511-1980-4cba-9c27-c2795556af75 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:10.608733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-86157511-1980-4cba-9c27-c2795556af75 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:10.624700 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-86157511-1980-4cba-9c27-c2795556af75 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] HTTP exception thrown: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-86157511-1980-4cba-9c27-c2795556af75 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Request method failure captured: Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 HTTP/1.1 Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA7xUtP-ikb0eO8-L8wa1U9tVnibx7-nGJqwmYbXf2MT1WxarA_36bruP5z3HPY_iasZlQTJej7wleO02jFCwb31Ht2XNYuRcgJ5iVmm2myKTiDU_0uj66-YheAnyu-sa6ej5AyWkMhn9WxiOxjxiMxJuc-CjWVB0slYCz2QJM91qf98 Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Openstack-Nova-Api-Version: 2.20 Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: c20e7f3aca4c49ae84390a3f1a8ce410 Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:39:10.626282 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:39:10.629211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c20e7f3aca4c49ae84390a3f1a8ce410"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c20e7f3aca4c49ae84390a3f1a8ce410", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:39:10.629211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:10.629211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: c20e7f3aca4c49ae84390a3f1a8ce410 Aug 22 17:39:10.629211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-830857878 Aug 22 17:39:10.629211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-AttachVolumeShelveTestJSON-830857878-project Aug 22 17:39:10.629211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:39:10.629211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:39:10.629211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: 864d7f47381e4e4498ad110dbfcfc154 Aug 22 17:39:10.629211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-AttachVolumeShelveTestJSON-830857878-project Aug 22 17:39:10.629211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:39:10.629211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:39:10.629211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': 'fcb3959b-fd48-4a97-81d0-5b74ec4cfd32'} Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:10.630624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. Aug 22 17:39:10.632965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.638090 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-86157511-1980-4cba-9c27-c2795556af75 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] Returning 404 to user: Instance fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:10.638090 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-86157511-1980-4cba-9c27-c2795556af75 tempest-AttachVolumeShelveTestJSON-830857878 tempest-AttachVolumeShelveTestJSON-830857878-project] 10.222.0.20 "GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32" status: 404 len: 111 microversion: 2.20 time: 0.032976 Aug 22 17:39:10.638090 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 501/1002] 10.222.0.20 () {60 vars in 1277 bytes} [Mon Aug 22 17:39:10 2022] GET /compute/v2.1/servers/fcb3959b-fd48-4a97-81d0-5b74ec4cfd32 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 22 17:39:10.845449 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ac15e882-e0ef-4184-8b2f-e29f74c0c8be tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:10.846398 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ac15e882-e0ef-4184-8b2f-e29f74c0c8be tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:10.853690 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ac15e882-e0ef-4184-8b2f-e29f74c0c8be tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:10.854464 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ac15e882-e0ef-4184-8b2f-e29f74c0c8be tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:10.855226 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ac15e882-e0ef-4184-8b2f-e29f74c0c8be tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:10.856646 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ac15e882-e0ef-4184-8b2f-e29f74c0c8be tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:10.857931 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ac15e882-e0ef-4184-8b2f-e29f74c0c8be tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:10.859615 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ac15e882-e0ef-4184-8b2f-e29f74c0c8be tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:10.886238 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-ac15e882-e0ef-4184-8b2f-e29f74c0c8be tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] HTTP exception thrown: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ac15e882-e0ef-4184-8b2f-e29f74c0c8be tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Request method failure captured: Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 HTTP/1.1 Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xLFyP3sazpo8lNxFPukerJWviDoPTaEBmzGGnNT2hK_WSNwW1QEyJSvA7cujhX4n3KzSw_ywGF8KgQMwv_P1bklerqKHJCnSQNmsRxQWmDXBuOt_ZETYxuWcB2qstyCMegdrnu-rvFjhw-dLXTo-dX3Y3VP9AGooFNTG8HqCGsto4 Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:39:10.890467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:39:10.893303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6436020e938047408d1f979e23dd48da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6436020e938047408d1f979e23dd48da", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:39:10.893303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:10.893303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:10.893303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:10.893303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:10.893303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:39:10.893303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:39:10.893303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: b0db362075b04b2294a6268576a5bba3 Aug 22 17:39:10.893303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:10.893303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:39:10.893303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:10.893303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '807e63ee-52a6-4bcc-bc90-d492fff06ad6'} Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:10.894720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:10.897208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:10.899927 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ac15e882-e0ef-4184-8b2f-e29f74c0c8be tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Returning 404 to user: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:10.899927 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ac15e882-e0ef-4184-8b2f-e29f74c0c8be tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 404 len: 111 microversion: 2.1 time: 0.052628 Aug 22 17:39:10.899927 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 502/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:10 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:39:10.906398 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-77903a9e-05f6-4cd4-a9a2-25deb55f4aed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '.version_select at 0x7f0e5c74df70>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:11.020133 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-77903a9e-05f6-4cd4-a9a2-25deb55f4aed tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-186687179" status: 202 len: 0 microversion: 2.1 time: 0.119208 Aug 22 17:39:11.020763 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 502/1004] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 22 17:39:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-186687179 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:39:13.634563 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-1455f4f2-aba7-498e-96cf-ad80cd3b88f1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:13.636259 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-1455f4f2-aba7-498e-96cf-ad80cd3b88f1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:13.642726 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1455f4f2-aba7-498e-96cf-ad80cd3b88f1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:13.643205 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1455f4f2-aba7-498e-96cf-ad80cd3b88f1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:13.643637 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1455f4f2-aba7-498e-96cf-ad80cd3b88f1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:13.644350 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1455f4f2-aba7-498e-96cf-ad80cd3b88f1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:13.644802 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1455f4f2-aba7-498e-96cf-ad80cd3b88f1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:13.645229 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-1455f4f2-aba7-498e-96cf-ad80cd3b88f1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:13.660835 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-1455f4f2-aba7-498e-96cf-ad80cd3b88f1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] HTTP exception thrown: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-1455f4f2-aba7-498e-96cf-ad80cd3b88f1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Request method failure captured: Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: DELETE /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 HTTP/1.1 Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xLFyP3sazpo8lNxFPukerJWviDoPTaEBmzGGnNT2hK_WSNwW1QEyJSvA7cujhX4n3KzSw_ywGF8KgQMwv_P1bklerqKHJCnSQNmsRxQWmDXBuOt_ZETYxuWcB2qstyCMegdrnu-rvFjhw-dLXTo-dX3Y3VP9AGooFNTG8HqCGsto4 Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:39:13.662409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:39:13.664099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6436020e938047408d1f979e23dd48da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6436020e938047408d1f979e23dd48da", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:39:13.664099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:13.664099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:13.664099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:13.664099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:13.664099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:39:13.664099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:39:13.664099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: b0db362075b04b2294a6268576a5bba3 Aug 22 17:39:13.664099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:13.664099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:39:13.664099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:13.664099 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '807e63ee-52a6-4bcc-bc90-d492fff06ad6'} Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:13.664993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:13.666463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:13.668140 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-1455f4f2-aba7-498e-96cf-ad80cd3b88f1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Returning 404 to user: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:13.668140 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-1455f4f2-aba7-498e-96cf-ad80cd3b88f1 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 404 len: 111 microversion: 2.1 time: 0.033379 Aug 22 17:39:13.668140 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 503/1005] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:39:13 2022] DELETE /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:39:13.673792 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cad929d5-88dc-4030-93d8-a780031346c8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:13.674409 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-cad929d5-88dc-4030-93d8-a780031346c8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: 807e63ee-52a6-4bcc-bc90-d492fff06ad6] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:13.681699 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cad929d5-88dc-4030-93d8-a780031346c8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:13.682189 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cad929d5-88dc-4030-93d8-a780031346c8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:13.682692 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cad929d5-88dc-4030-93d8-a780031346c8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:13.683401 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cad929d5-88dc-4030-93d8-a780031346c8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:13.683850 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cad929d5-88dc-4030-93d8-a780031346c8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:13.684841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cad929d5-88dc-4030-93d8-a780031346c8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:13.699553 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-cad929d5-88dc-4030-93d8-a780031346c8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] HTTP exception thrown: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cad929d5-88dc-4030-93d8-a780031346c8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Request method failure captured: Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 HTTP/1.1 Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA7xLFyP3sazpo8lNxFPukerJWviDoPTaEBmzGGnNT2hK_WSNwW1QEyJSvA7cujhX4n3KzSw_ywGF8KgQMwv_P1bklerqKHJCnSQNmsRxQWmDXBuOt_ZETYxuWcB2qstyCMegdrnu-rvFjhw-dLXTo-dX3Y3VP9AGooFNTG8HqCGsto4 Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:39:13.702270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:39:13.704283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6436020e938047408d1f979e23dd48da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6436020e938047408d1f979e23dd48da", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:39:13.704283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:13.704283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:13.704283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:13.704283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:13.704283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:39:13.704283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:39:13.704283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: b0db362075b04b2294a6268576a5bba3 Aug 22 17:39:13.704283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:13.704283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:39:13.704283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:13.704283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': '807e63ee-52a6-4bcc-bc90-d492fff06ad6'} Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:13.709384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. Aug 22 17:39:13.710981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:13.712782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cad929d5-88dc-4030-93d8-a780031346c8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Returning 404 to user: Instance 807e63ee-52a6-4bcc-bc90-d492fff06ad6 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:13.712782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-cad929d5-88dc-4030-93d8-a780031346c8 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6" status: 404 len: 111 microversion: 2.1 time: 0.034583 Aug 22 17:39:13.712782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 503/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:13 2022] GET /compute/v2.1/servers/807e63ee-52a6-4bcc-bc90-d492fff06ad6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:39:15.117191 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4150ef4d-9a0e-483c-a56c-b5b59f97c7ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:15.118965 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4150ef4d-9a0e-483c-a56c-b5b59f97c7ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:15.131442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4150ef4d-9a0e-483c-a56c-b5b59f97c7ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:15.132663 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4150ef4d-9a0e-483c-a56c-b5b59f97c7ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:15.133669 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4150ef4d-9a0e-483c-a56c-b5b59f97c7ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:15.135228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4150ef4d-9a0e-483c-a56c-b5b59f97c7ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:15.136304 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4150ef4d-9a0e-483c-a56c-b5b59f97c7ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:15.137964 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4150ef4d-9a0e-483c-a56c-b5b59f97c7ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:15.165199 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-4150ef4d-9a0e-483c-a56c-b5b59f97c7ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] HTTP exception thrown: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4150ef4d-9a0e-483c-a56c-b5b59f97c7ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Request method failure captured: Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: DELETE /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 HTTP/1.1 Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xLFyP3sazpo8lNxFPukerJWviDoPTaEBmzGGnNT2hK_WSNwW1QEyJSvA7cujhX4n3KzSw_ywGF8KgQMwv_P1bklerqKHJCnSQNmsRxQWmDXBuOt_ZETYxuWcB2qstyCMegdrnu-rvFjhw-dLXTo-dX3Y3VP9AGooFNTG8HqCGsto4 Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:39:15.168228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:39:15.170330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6436020e938047408d1f979e23dd48da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6436020e938047408d1f979e23dd48da", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:39:15.170330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:15.170330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:15.170330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:15.170330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:15.170330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:39:15.170330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:39:15.170330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: b0db362075b04b2294a6268576a5bba3 Aug 22 17:39:15.170330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:15.170330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:39:15.170330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:39:15.170330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': 'da06f40f-ae38-492b-8867-2ffe54655d17'} Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:15.171274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:39:15.173570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.174939 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4150ef4d-9a0e-483c-a56c-b5b59f97c7ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Returning 404 to user: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:15.174939 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4150ef4d-9a0e-483c-a56c-b5b59f97c7ae tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 404 len: 111 microversion: 2.1 time: 0.061404 Aug 22 17:39:15.174939 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 504/1007] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:39:15 2022] DELETE /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:39:15.183713 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e17ceb91-5c16-47c7-b629-410bad14fd8a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:15.185306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e17ceb91-5c16-47c7-b629-410bad14fd8a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: da06f40f-ae38-492b-8867-2ffe54655d17] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:15.193638 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e17ceb91-5c16-47c7-b629-410bad14fd8a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:15.194259 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e17ceb91-5c16-47c7-b629-410bad14fd8a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:15.194864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e17ceb91-5c16-47c7-b629-410bad14fd8a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:15.195698 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e17ceb91-5c16-47c7-b629-410bad14fd8a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:15.196255 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e17ceb91-5c16-47c7-b629-410bad14fd8a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:15.196781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e17ceb91-5c16-47c7-b629-410bad14fd8a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:15.214627 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-e17ceb91-5c16-47c7-b629-410bad14fd8a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] HTTP exception thrown: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e17ceb91-5c16-47c7-b629-410bad14fd8a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Request method failure captured: Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 HTTP/1.1 Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA7xLFyP3sazpo8lNxFPukerJWviDoPTaEBmzGGnNT2hK_WSNwW1QEyJSvA7cujhX4n3KzSw_ywGF8KgQMwv_P1bklerqKHJCnSQNmsRxQWmDXBuOt_ZETYxuWcB2qstyCMegdrnu-rvFjhw-dLXTo-dX3Y3VP9AGooFNTG8HqCGsto4 Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:39:15.217616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:39:15.219325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6436020e938047408d1f979e23dd48da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6436020e938047408d1f979e23dd48da", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:39:15.219325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:15.219325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:15.219325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:15.219325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:15.219325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:39:15.219325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:39:15.219325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: b0db362075b04b2294a6268576a5bba3 Aug 22 17:39:15.219325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:15.219325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:39:15.219325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:39:15.219325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': 'da06f40f-ae38-492b-8867-2ffe54655d17'} Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:15.220598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. Aug 22 17:39:15.223959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.225378 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e17ceb91-5c16-47c7-b629-410bad14fd8a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Returning 404 to user: Instance da06f40f-ae38-492b-8867-2ffe54655d17 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:15.225378 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e17ceb91-5c16-47c7-b629-410bad14fd8a tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17" status: 404 len: 111 microversion: 2.1 time: 0.039749 Aug 22 17:39:15.225378 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 504/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:15 2022] GET /compute/v2.1/servers/da06f40f-ae38-492b-8867-2ffe54655d17 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:39:15.233314 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b6b0a7d3-ad85-45fa-b854-eb30f1123999 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:15.234197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b6b0a7d3-ad85-45fa-b854-eb30f1123999 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:15.247976 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b6b0a7d3-ad85-45fa-b854-eb30f1123999 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:15.249221 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b6b0a7d3-ad85-45fa-b854-eb30f1123999 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:15.250240 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b6b0a7d3-ad85-45fa-b854-eb30f1123999 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:15.253140 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b6b0a7d3-ad85-45fa-b854-eb30f1123999 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:15.253140 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b6b0a7d3-ad85-45fa-b854-eb30f1123999 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:15.254411 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b6b0a7d3-ad85-45fa-b854-eb30f1123999 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:15.286147 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-b6b0a7d3-ad85-45fa-b854-eb30f1123999 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] HTTP exception thrown: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b6b0a7d3-ad85-45fa-b854-eb30f1123999 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Request method failure captured: Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: DELETE /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c HTTP/1.1 Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xLFyP3sazpo8lNxFPukerJWviDoPTaEBmzGGnNT2hK_WSNwW1QEyJSvA7cujhX4n3KzSw_ywGF8KgQMwv_P1bklerqKHJCnSQNmsRxQWmDXBuOt_ZETYxuWcB2qstyCMegdrnu-rvFjhw-dLXTo-dX3Y3VP9AGooFNTG8HqCGsto4 Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:39:15.289368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:39:15.295461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6436020e938047408d1f979e23dd48da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6436020e938047408d1f979e23dd48da", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:39:15.295461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:15.295461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:15.295461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:15.295461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:15.295461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:39:15.295461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:39:15.295461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: b0db362075b04b2294a6268576a5bba3 Aug 22 17:39:15.295461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:15.295461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:39:15.295461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:39:15.295461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': 'd3e55a36-fde4-47f6-bc2b-9ab85db48b7c'} Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:15.297268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:39:15.299892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.301707 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b6b0a7d3-ad85-45fa-b854-eb30f1123999 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Returning 404 to user: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:15.301707 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b6b0a7d3-ad85-45fa-b854-eb30f1123999 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 404 len: 111 microversion: 2.1 time: 0.065541 Aug 22 17:39:15.301707 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 505/1009] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:39:15 2022] DELETE /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:39:15.307088 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b5ccc92c-d537-433f-96fa-43d65d4f3cb6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:15.311724 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b5ccc92c-d537-433f-96fa-43d65d4f3cb6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: d3e55a36-fde4-47f6-bc2b-9ab85db48b7c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:15.318446 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b5ccc92c-d537-433f-96fa-43d65d4f3cb6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:15.319585 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b5ccc92c-d537-433f-96fa-43d65d4f3cb6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:15.320536 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b5ccc92c-d537-433f-96fa-43d65d4f3cb6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:15.320788 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b5ccc92c-d537-433f-96fa-43d65d4f3cb6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:15.321256 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b5ccc92c-d537-433f-96fa-43d65d4f3cb6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:15.321698 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b5ccc92c-d537-433f-96fa-43d65d4f3cb6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:15.337838 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-b5ccc92c-d537-433f-96fa-43d65d4f3cb6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] HTTP exception thrown: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b5ccc92c-d537-433f-96fa-43d65d4f3cb6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Request method failure captured: Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c HTTP/1.1 Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA7xLFyP3sazpo8lNxFPukerJWviDoPTaEBmzGGnNT2hK_WSNwW1QEyJSvA7cujhX4n3KzSw_ywGF8KgQMwv_P1bklerqKHJCnSQNmsRxQWmDXBuOt_ZETYxuWcB2qstyCMegdrnu-rvFjhw-dLXTo-dX3Y3VP9AGooFNTG8HqCGsto4 Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:39:15.339602 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:39:15.342969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6436020e938047408d1f979e23dd48da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6436020e938047408d1f979e23dd48da", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:39:15.342969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:15.342969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:15.342969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:15.342969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:15.342969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:39:15.342969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:39:15.342969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: b0db362075b04b2294a6268576a5bba3 Aug 22 17:39:15.342969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:15.342969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:39:15.342969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:39:15.342969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': 'd3e55a36-fde4-47f6-bc2b-9ab85db48b7c'} Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:15.344663 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. Aug 22 17:39:15.347796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:15.350589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b5ccc92c-d537-433f-96fa-43d65d4f3cb6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Returning 404 to user: Instance d3e55a36-fde4-47f6-bc2b-9ab85db48b7c could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:15.350589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b5ccc92c-d537-433f-96fa-43d65d4f3cb6 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c" status: 404 len: 111 microversion: 2.1 time: 0.042190 Aug 22 17:39:15.350589 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 505/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:15 2022] GET /compute/v2.1/servers/d3e55a36-fde4-47f6-bc2b-9ab85db48b7c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:39:16.697537 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3dd84adb-c242-4b3a-8275-4b8c25426e1d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:16.698105 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3dd84adb-c242-4b3a-8275-4b8c25426e1d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:16.705527 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3dd84adb-c242-4b3a-8275-4b8c25426e1d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:16.706023 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3dd84adb-c242-4b3a-8275-4b8c25426e1d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:16.706466 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3dd84adb-c242-4b3a-8275-4b8c25426e1d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:16.707208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3dd84adb-c242-4b3a-8275-4b8c25426e1d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:16.707668 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3dd84adb-c242-4b3a-8275-4b8c25426e1d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:16.708097 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3dd84adb-c242-4b3a-8275-4b8c25426e1d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:16.724261 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-3dd84adb-c242-4b3a-8275-4b8c25426e1d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] HTTP exception thrown: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3dd84adb-c242-4b3a-8275-4b8c25426e1d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Request method failure captured: Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: DELETE /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 HTTP/1.1 Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA7xLFyP3sazpo8lNxFPukerJWviDoPTaEBmzGGnNT2hK_WSNwW1QEyJSvA7cujhX4n3KzSw_ywGF8KgQMwv_P1bklerqKHJCnSQNmsRxQWmDXBuOt_ZETYxuWcB2qstyCMegdrnu-rvFjhw-dLXTo-dX3Y3VP9AGooFNTG8HqCGsto4 Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:39:16.728364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:39:16.729916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6436020e938047408d1f979e23dd48da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6436020e938047408d1f979e23dd48da", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:39:16.729916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:16.729916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:16.729916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:16.729916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:16.729916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:39:16.729916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:39:16.729916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: b0db362075b04b2294a6268576a5bba3 Aug 22 17:39:16.729916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:16.729916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:39:16.729916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:39:16.729916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': 'e1c1f97f-c673-4f7b-8ecf-45396ce57516'} Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:16.732117 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:39:16.733752 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:39:16.735457 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3dd84adb-c242-4b3a-8275-4b8c25426e1d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Returning 404 to user: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:16.735457 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3dd84adb-c242-4b3a-8275-4b8c25426e1d tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 404 len: 111 microversion: 2.1 time: 0.033856 Aug 22 17:39:16.735457 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 506/1011] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:39:16 2022] DELETE /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:39:16.739292 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c1571ef9-7f78-4aed-bd0e-a07cd6f46c04 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:16.740039 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c1571ef9-7f78-4aed-bd0e-a07cd6f46c04 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] [instance: e1c1f97f-c673-4f7b-8ecf-45396ce57516] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:16.748515 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1571ef9-7f78-4aed-bd0e-a07cd6f46c04 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:16.749252 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1571ef9-7f78-4aed-bd0e-a07cd6f46c04 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:16.749893 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1571ef9-7f78-4aed-bd0e-a07cd6f46c04 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:16.750838 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1571ef9-7f78-4aed-bd0e-a07cd6f46c04 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:16.751775 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1571ef9-7f78-4aed-bd0e-a07cd6f46c04 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:16.752559 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c1571ef9-7f78-4aed-bd0e-a07cd6f46c04 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:16.774808 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-c1571ef9-7f78-4aed-bd0e-a07cd6f46c04 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] HTTP exception thrown: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c1571ef9-7f78-4aed-bd0e-a07cd6f46c04 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Request method failure captured: Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 HTTP/1.1 Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA7xLFyP3sazpo8lNxFPukerJWviDoPTaEBmzGGnNT2hK_WSNwW1QEyJSvA7cujhX4n3KzSw_ywGF8KgQMwv_P1bklerqKHJCnSQNmsRxQWmDXBuOt_ZETYxuWcB2qstyCMegdrnu-rvFjhw-dLXTo-dX3Y3VP9AGooFNTG8HqCGsto4 Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:39:16.776363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:39:16.785989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6436020e938047408d1f979e23dd48da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6436020e938047408d1f979e23dd48da"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6436020e938047408d1f979e23dd48da", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:39:16.785989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:16.785989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 6436020e938047408d1f979e23dd48da Aug 22 17:39:16.785989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-60941358 Aug 22 17:39:16.785989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:16.785989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:39:16.785989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:39:16.785989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: b0db362075b04b2294a6268576a5bba3 Aug 22 17:39:16.785989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-AttachVolumeNegativeTest-60941358-project Aug 22 17:39:16.785989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:39:16.785989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:39:16.785989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': 'e1c1f97f-c673-4f7b-8ecf-45396ce57516'} Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:39:16.792014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. Aug 22 17:39:16.795438 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:39:16.797363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c1571ef9-7f78-4aed-bd0e-a07cd6f46c04 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] Returning 404 to user: Instance e1c1f97f-c673-4f7b-8ecf-45396ce57516 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:39:16.797363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c1571ef9-7f78-4aed-bd0e-a07cd6f46c04 tempest-AttachVolumeNegativeTest-60941358 tempest-AttachVolumeNegativeTest-60941358-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516" status: 404 len: 111 microversion: 2.1 time: 0.043708 Aug 22 17:39:16.797363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 506/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:16 2022] GET /compute/v2.1/servers/e1c1f97f-c673-4f7b-8ecf-45396ce57516 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:39:26.463204 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0ffd7081-7156-4691-8068-307dc72d5ab0 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Action: 'create', calling method: .version_select at 0x7f0e5cf2caf0>, body: {"keypair": {"name": "tempest-keypair-1110229342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJM54yVZjMmMWK5QWyCa3y0kw1ZTG0d1v//Jxd2Lz7ZlC+JMH5yCpYKuUohGPJD0qgdt34qDDpJx7e/cQ6L0+C/HjBNz1bGs9FYTcD5y8TFAQ+y9QqCsVLz8LxFVyAIF0A=="}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:39:26.484240 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-0ffd7081-7156-4691-8068-307dc72d5ab0 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Getting quotas for project 5f7d9ac076ce40b09043ced00f54f33a. Resources: {'key_pairs'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:39:26.492325 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-0ffd7081-7156-4691-8068-307dc72d5ab0 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Getting quotas for user 5042520b122a4c6c94321a50ea57633a and project 5f7d9ac076ce40b09043ced00f54f33a. Resources: {'key_pairs'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:39:26.632065 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0ffd7081-7156-4691-8068-307dc72d5ab0 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.560655 Aug 22 17:39:26.632870 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 507/1013] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 22 17:39:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:39:30.215502 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-932419657", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2a3fa06-167f-4474-afdd-acf70dfabd5c"}], "security_groups": [{"name": "tempest-securitygroup--1665802016"}], "key_name": "tempest-keypair-1110229342", "user_data": "}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:39:30.232726 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:30.233815 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:30.361423 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.network.neutron [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] validate_networks() for [('f2a3fa06-167f-4474-afdd-acf70dfabd5c', None, None, None, None, None)] {{(pid=121853) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:39:30.933041 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Flavor limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:39:30.934008 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Image limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:39:30.934552 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Flavor pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:39:30.935260 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Image pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:39:30.935672 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:39:30.945016 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:30.945490 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:30.945939 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:30.946681 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:30.947168 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:30.947576 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:30.965940 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Getting quotas for project 5f7d9ac076ce40b09043ced00f54f33a. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:39:30.970328 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Getting quotas for user 5042520b122a4c6c94321a50ea57633a and project 5f7d9ac076ce40b09043ced00f54f33a. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:39:30.982943 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Going to run 1 instances... {{(pid=121853) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:39:30.985313 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:39:31.168761 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR oslo.messaging._drivers.impl_rabbit [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [500336a7-d6a6-43ff-80bf-0e701def86d6] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 17:39:32.181526 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO oslo.messaging._drivers.impl_rabbit [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [500336a7-d6a6-43ff-80bf-0e701def86d6] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 43510. Aug 22 17:39:32.198765 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1321c4e7-8d1c-4d1f-b4f0-792fbd8f398d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.988006 Aug 22 17:39:32.200460 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 507/1014] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:39:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:39:32.208445 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:32.213255 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-cea916bb-56d8-4e85-bf65-a7a7c518a704 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:32.213898 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-cea916bb-56d8-4e85-bf65-a7a7c518a704 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:32.222236 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:32.305586 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-cea916bb-56d8-4e85-bf65-a7a7c518a704 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:32.317254 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-cea916bb-56d8-4e85-bf65-a7a7c518a704 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1237 microversion: 2.1 time: 0.109512 Aug 22 17:39:32.320950 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 508/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:32 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1237 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:33.341846 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-06cb3201-1148-4ab5-8ae1-0a2cb0e0090a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:33.342467 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-06cb3201-1148-4ab5-8ae1-0a2cb0e0090a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:33.403669 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-06cb3201-1148-4ab5-8ae1-0a2cb0e0090a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:33.418611 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-06cb3201-1148-4ab5-8ae1-0a2cb0e0090a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1237 microversion: 2.1 time: 0.080178 Aug 22 17:39:33.419758 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 508/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:33 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1237 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:34.446308 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5399945a-1b08-4a63-95d8-db296359f68a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:34.447069 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5399945a-1b08-4a63-95d8-db296359f68a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:34.456278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5399945a-1b08-4a63-95d8-db296359f68a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:34.456804 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5399945a-1b08-4a63-95d8-db296359f68a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:34.457258 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5399945a-1b08-4a63-95d8-db296359f68a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:34.457998 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5399945a-1b08-4a63-95d8-db296359f68a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:34.458465 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5399945a-1b08-4a63-95d8-db296359f68a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:34.458932 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5399945a-1b08-4a63-95d8-db296359f68a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:34.529375 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5399945a-1b08-4a63-95d8-db296359f68a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:34.538242 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5399945a-1b08-4a63-95d8-db296359f68a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1241 microversion: 2.1 time: 0.096486 Aug 22 17:39:34.547876 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 509/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:34 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:35.567140 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-42905abc-90b6-43e1-a732-97c48ff59b3d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:35.567805 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-42905abc-90b6-43e1-a732-97c48ff59b3d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:35.575354 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-42905abc-90b6-43e1-a732-97c48ff59b3d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:35.575865 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-42905abc-90b6-43e1-a732-97c48ff59b3d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:35.576330 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-42905abc-90b6-43e1-a732-97c48ff59b3d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:35.577051 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-42905abc-90b6-43e1-a732-97c48ff59b3d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:35.577512 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-42905abc-90b6-43e1-a732-97c48ff59b3d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:35.577936 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-42905abc-90b6-43e1-a732-97c48ff59b3d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:35.643094 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-42905abc-90b6-43e1-a732-97c48ff59b3d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:35.651235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-42905abc-90b6-43e1-a732-97c48ff59b3d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1241 microversion: 2.1 time: 0.088092 Aug 22 17:39:35.652312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 509/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:35 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1241 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:36.673385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-38038945-51a5-4f09-8689-fb77ca7e0475 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:36.673986 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-38038945-51a5-4f09-8689-fb77ca7e0475 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:36.683776 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-38038945-51a5-4f09-8689-fb77ca7e0475 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:36.685687 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-38038945-51a5-4f09-8689-fb77ca7e0475 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:36.685687 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-38038945-51a5-4f09-8689-fb77ca7e0475 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:36.685687 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-38038945-51a5-4f09-8689-fb77ca7e0475 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:36.686091 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-38038945-51a5-4f09-8689-fb77ca7e0475 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:36.686915 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-38038945-51a5-4f09-8689-fb77ca7e0475 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:36.776333 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-38038945-51a5-4f09-8689-fb77ca7e0475 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:36.785860 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-38038945-51a5-4f09-8689-fb77ca7e0475 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1233 microversion: 2.1 time: 0.116375 Aug 22 17:39:36.786566 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 510/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:36 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1233 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:37.808790 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0ff3945f-dc0e-4fbe-9e1d-ff25db20d14b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:37.811094 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0ff3945f-dc0e-4fbe-9e1d-ff25db20d14b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:37.817034 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ff3945f-dc0e-4fbe-9e1d-ff25db20d14b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:37.817688 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ff3945f-dc0e-4fbe-9e1d-ff25db20d14b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:37.818119 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ff3945f-dc0e-4fbe-9e1d-ff25db20d14b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:37.818848 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ff3945f-dc0e-4fbe-9e1d-ff25db20d14b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:37.819297 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ff3945f-dc0e-4fbe-9e1d-ff25db20d14b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:37.819716 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0ff3945f-dc0e-4fbe-9e1d-ff25db20d14b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:37.892081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0ff3945f-dc0e-4fbe-9e1d-ff25db20d14b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:37.900571 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0ff3945f-dc0e-4fbe-9e1d-ff25db20d14b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1289 microversion: 2.1 time: 0.096663 Aug 22 17:39:37.901155 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 510/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:37 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1289 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:38.926572 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-db8c0d17-4c6a-4445-b482-7f293a4219cb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:38.927201 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-db8c0d17-4c6a-4445-b482-7f293a4219cb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:38.936738 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-db8c0d17-4c6a-4445-b482-7f293a4219cb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:38.936738 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-db8c0d17-4c6a-4445-b482-7f293a4219cb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:38.937060 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-db8c0d17-4c6a-4445-b482-7f293a4219cb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:38.938076 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-db8c0d17-4c6a-4445-b482-7f293a4219cb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:38.938743 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-db8c0d17-4c6a-4445-b482-7f293a4219cb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:38.939337 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-db8c0d17-4c6a-4445-b482-7f293a4219cb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:39.062621 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-db8c0d17-4c6a-4445-b482-7f293a4219cb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:39.086244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-db8c0d17-4c6a-4445-b482-7f293a4219cb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1307 microversion: 2.1 time: 0.168139 Aug 22 17:39:39.087744 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 511/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:38 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1307 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:40.118920 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5c4a9fea-36cc-4783-9e73-c8c80e82ae9b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:40.119790 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5c4a9fea-36cc-4783-9e73-c8c80e82ae9b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:40.129496 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c4a9fea-36cc-4783-9e73-c8c80e82ae9b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:40.130458 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c4a9fea-36cc-4783-9e73-c8c80e82ae9b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:40.130928 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c4a9fea-36cc-4783-9e73-c8c80e82ae9b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:40.132097 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c4a9fea-36cc-4783-9e73-c8c80e82ae9b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:40.132552 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c4a9fea-36cc-4783-9e73-c8c80e82ae9b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:40.132971 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c4a9fea-36cc-4783-9e73-c8c80e82ae9b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:40.303980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5c4a9fea-36cc-4783-9e73-c8c80e82ae9b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:40.314228 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5c4a9fea-36cc-4783-9e73-c8c80e82ae9b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1363 microversion: 2.1 time: 0.200587 Aug 22 17:39:40.315051 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 511/1022] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:40 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:40.652281 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-3e772395-5e56-4954-96c2-610cf8ebaee3 req-2581f8e3-e1ae-465e-91b0-62d18395edf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3c3789f-b7a2-49c1-a3f1-74819ced4a46", "tag": "c63e0529-5820-4836-a08f-6f39ef67edb8"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:39:40.679454 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-3e772395-5e56-4954-96c2-610cf8ebaee3 req-2581f8e3-e1ae-465e-91b0-62d18395edf0 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:40.680289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-3e772395-5e56-4954-96c2-610cf8ebaee3 req-2581f8e3-e1ae-465e-91b0-62d18395edf0 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:40.681035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-3e772395-5e56-4954-96c2-610cf8ebaee3 req-2581f8e3-e1ae-465e-91b0-62d18395edf0 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:40.705882 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-3e772395-5e56-4954-96c2-610cf8ebaee3 req-2581f8e3-e1ae-465e-91b0-62d18395edf0 service nova] Creating event network-changed:c63e0529-5820-4836-a08f-6f39ef67edb8 for instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 on hv-cinder-85394 Aug 22 17:39:40.716767 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-3e772395-5e56-4954-96c2-610cf8ebaee3 req-2581f8e3-e1ae-465e-91b0-62d18395edf0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070929 Aug 22 17:39:40.722448 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 512/1023] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:39:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:39:41.340553 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-bd05eea8-639a-4943-b4f1-47c0318e1efb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:41.341850 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-bd05eea8-639a-4943-b4f1-47c0318e1efb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:41.345118 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:41.356575 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd05eea8-639a-4943-b4f1-47c0318e1efb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:41.357458 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd05eea8-639a-4943-b4f1-47c0318e1efb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:41.358294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd05eea8-639a-4943-b4f1-47c0318e1efb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:41.359567 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd05eea8-639a-4943-b4f1-47c0318e1efb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:41.360440 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd05eea8-639a-4943-b4f1-47c0318e1efb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:41.361111 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd05eea8-639a-4943-b4f1-47c0318e1efb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:41.536523 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-bd05eea8-639a-4943-b4f1-47c0318e1efb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:41.546099 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-bd05eea8-639a-4943-b4f1-47c0318e1efb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1363 microversion: 2.1 time: 0.212293 Aug 22 17:39:41.546884 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 512/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:41 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:42.566623 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=6 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:42.571190 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d5c30f8d-f47c-44c7-90ff-9e0e9ac7606d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:42.572003 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d5c30f8d-f47c-44c7-90ff-9e0e9ac7606d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:42.578353 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d5c30f8d-f47c-44c7-90ff-9e0e9ac7606d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:42.579580 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d5c30f8d-f47c-44c7-90ff-9e0e9ac7606d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:42.579580 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d5c30f8d-f47c-44c7-90ff-9e0e9ac7606d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:42.581928 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d5c30f8d-f47c-44c7-90ff-9e0e9ac7606d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:42.581928 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d5c30f8d-f47c-44c7-90ff-9e0e9ac7606d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:42.581928 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d5c30f8d-f47c-44c7-90ff-9e0e9ac7606d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:42.761763 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-d5c30f8d-f47c-44c7-90ff-9e0e9ac7606d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:42.777432 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d5c30f8d-f47c-44c7-90ff-9e0e9ac7606d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1363 microversion: 2.1 time: 0.211110 Aug 22 17:39:42.778601 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 513/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:42 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:43.799712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-16cd68ad-3358-4d82-9e54-0a1adecb2f7f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:43.800329 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-16cd68ad-3358-4d82-9e54-0a1adecb2f7f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:43.802216 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=8 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:39:43.807528 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-16cd68ad-3358-4d82-9e54-0a1adecb2f7f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:43.808625 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-16cd68ad-3358-4d82-9e54-0a1adecb2f7f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:43.809065 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-16cd68ad-3358-4d82-9e54-0a1adecb2f7f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:43.809871 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-16cd68ad-3358-4d82-9e54-0a1adecb2f7f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:43.810364 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-16cd68ad-3358-4d82-9e54-0a1adecb2f7f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:43.810829 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-16cd68ad-3358-4d82-9e54-0a1adecb2f7f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:44.009780 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-16cd68ad-3358-4d82-9e54-0a1adecb2f7f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:44.026658 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-16cd68ad-3358-4d82-9e54-0a1adecb2f7f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1363 microversion: 2.1 time: 0.230881 Aug 22 17:39:44.028697 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 513/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:43 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:45.050834 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-7877ad0d-c4fe-4ca8-848d-92e13ab47f98 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:45.060659 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-7877ad0d-c4fe-4ca8-848d-92e13ab47f98 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:45.061467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7877ad0d-c4fe-4ca8-848d-92e13ab47f98 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:45.062234 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7877ad0d-c4fe-4ca8-848d-92e13ab47f98 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:45.062921 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7877ad0d-c4fe-4ca8-848d-92e13ab47f98 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:45.063899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7877ad0d-c4fe-4ca8-848d-92e13ab47f98 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:45.064599 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7877ad0d-c4fe-4ca8-848d-92e13ab47f98 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:45.065505 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7877ad0d-c4fe-4ca8-848d-92e13ab47f98 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:45.234286 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-7877ad0d-c4fe-4ca8-848d-92e13ab47f98 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:45.243795 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-7877ad0d-c4fe-4ca8-848d-92e13ab47f98 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1363 microversion: 2.1 time: 0.197542 Aug 22 17:39:45.244385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 514/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:45 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:46.273290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-198b2343-a62f-4a5f-89a2-1e1a17983435 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:46.273931 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-198b2343-a62f-4a5f-89a2-1e1a17983435 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:46.284250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-198b2343-a62f-4a5f-89a2-1e1a17983435 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:46.284749 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-198b2343-a62f-4a5f-89a2-1e1a17983435 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:46.285186 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-198b2343-a62f-4a5f-89a2-1e1a17983435 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:46.285900 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-198b2343-a62f-4a5f-89a2-1e1a17983435 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:46.286356 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-198b2343-a62f-4a5f-89a2-1e1a17983435 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:46.286808 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-198b2343-a62f-4a5f-89a2-1e1a17983435 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:46.455081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-198b2343-a62f-4a5f-89a2-1e1a17983435 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:46.469604 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-198b2343-a62f-4a5f-89a2-1e1a17983435 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1363 microversion: 2.1 time: 0.199737 Aug 22 17:39:46.470549 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 514/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:46 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1363 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:47.350105 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-f1c42af6-ab37-4618-8827-dabad5c8b6b4 req-8dd98366-b528-4477-85f5-085bb5af63cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c3789f-b7a2-49c1-a3f1-74819ced4a46", "name": "network-vif-plugged", "status": "completed", "tag": "c63e0529-5820-4836-a08f-6f39ef67edb8"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:39:47.369159 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-f1c42af6-ab37-4618-8827-dabad5c8b6b4 req-8dd98366-b528-4477-85f5-085bb5af63cb service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:47.369979 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-f1c42af6-ab37-4618-8827-dabad5c8b6b4 req-8dd98366-b528-4477-85f5-085bb5af63cb service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:47.372157 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-f1c42af6-ab37-4618-8827-dabad5c8b6b4 req-8dd98366-b528-4477-85f5-085bb5af63cb service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:47.385053 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-f1c42af6-ab37-4618-8827-dabad5c8b6b4 req-8dd98366-b528-4477-85f5-085bb5af63cb service nova] Creating event network-vif-plugged:c63e0529-5820-4836-a08f-6f39ef67edb8 for instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 on hv-cinder-85394 Aug 22 17:39:47.390854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-f1c42af6-ab37-4618-8827-dabad5c8b6b4 req-8dd98366-b528-4477-85f5-085bb5af63cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047354 Aug 22 17:39:47.391466 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 515/1029] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:39:47.497509 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ea044de5-b182-45be-946b-cc00f46051fc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:47.500153 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ea044de5-b182-45be-946b-cc00f46051fc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:47.510459 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea044de5-b182-45be-946b-cc00f46051fc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:47.515363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea044de5-b182-45be-946b-cc00f46051fc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:47.515363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea044de5-b182-45be-946b-cc00f46051fc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:47.515363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea044de5-b182-45be-946b-cc00f46051fc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:47.515363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea044de5-b182-45be-946b-cc00f46051fc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:47.516017 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea044de5-b182-45be-946b-cc00f46051fc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:47.697408 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ea044de5-b182-45be-946b-cc00f46051fc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:47.708213 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ea044de5-b182-45be-946b-cc00f46051fc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1363 microversion: 2.1 time: 0.219077 Aug 22 17:39:47.708878 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 515/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:47 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:48.734410 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3ef57c60-3bf5-4a56-b403-ba70f26df93a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:48.735217 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3ef57c60-3bf5-4a56-b403-ba70f26df93a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:48.742074 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3ef57c60-3bf5-4a56-b403-ba70f26df93a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:48.748576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3ef57c60-3bf5-4a56-b403-ba70f26df93a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:48.748576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3ef57c60-3bf5-4a56-b403-ba70f26df93a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:48.748576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3ef57c60-3bf5-4a56-b403-ba70f26df93a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:48.748576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3ef57c60-3bf5-4a56-b403-ba70f26df93a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:48.748978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3ef57c60-3bf5-4a56-b403-ba70f26df93a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:48.893594 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3ef57c60-3bf5-4a56-b403-ba70f26df93a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:48.903167 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3ef57c60-3bf5-4a56-b403-ba70f26df93a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1363 microversion: 2.1 time: 0.173346 Aug 22 17:39:48.903879 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 516/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:48 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:49.924482 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ce56aea9-468e-4f09-a9e7-d3b59b7bc8af tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:49.925235 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ce56aea9-468e-4f09-a9e7-d3b59b7bc8af tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:49.932053 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce56aea9-468e-4f09-a9e7-d3b59b7bc8af tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:49.932600 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce56aea9-468e-4f09-a9e7-d3b59b7bc8af tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:49.933046 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce56aea9-468e-4f09-a9e7-d3b59b7bc8af tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:49.933756 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce56aea9-468e-4f09-a9e7-d3b59b7bc8af tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:49.934208 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce56aea9-468e-4f09-a9e7-d3b59b7bc8af tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:49.934669 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ce56aea9-468e-4f09-a9e7-d3b59b7bc8af tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:50.143006 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ce56aea9-468e-4f09-a9e7-d3b59b7bc8af tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:50.152500 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ce56aea9-468e-4f09-a9e7-d3b59b7bc8af tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1549 microversion: 2.1 time: 0.231727 Aug 22 17:39:50.154815 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 516/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:49 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1549 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:50.176430 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d92d9c4a-a913-474d-8684-b9e2ae485b91 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:50.177118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d92d9c4a-a913-474d-8684-b9e2ae485b91 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:50.184916 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d92d9c4a-a913-474d-8684-b9e2ae485b91 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:50.185608 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d92d9c4a-a913-474d-8684-b9e2ae485b91 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:50.186332 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d92d9c4a-a913-474d-8684-b9e2ae485b91 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:50.187336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d92d9c4a-a913-474d-8684-b9e2ae485b91 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:50.187840 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d92d9c4a-a913-474d-8684-b9e2ae485b91 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:50.188351 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d92d9c4a-a913-474d-8684-b9e2ae485b91 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:50.315275 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d92d9c4a-a913-474d-8684-b9e2ae485b91 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144552 Aug 22 17:39:50.315865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 517/1033] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 22 17:39:50 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:39:51.859216 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-002571a4-a6f1-4be6-b608-5e789aca6df2 req-0c881522-d691-432b-b289-03433187f0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3c3789f-b7a2-49c1-a3f1-74819ced4a46", "tag": "c63e0529-5820-4836-a08f-6f39ef67edb8"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:39:51.869792 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-002571a4-a6f1-4be6-b608-5e789aca6df2 req-0c881522-d691-432b-b289-03433187f0e8 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:51.870891 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-002571a4-a6f1-4be6-b608-5e789aca6df2 req-0c881522-d691-432b-b289-03433187f0e8 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:51.871430 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-002571a4-a6f1-4be6-b608-5e789aca6df2 req-0c881522-d691-432b-b289-03433187f0e8 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:51.883859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-002571a4-a6f1-4be6-b608-5e789aca6df2 req-0c881522-d691-432b-b289-03433187f0e8 service nova] Creating event network-changed:c63e0529-5820-4836-a08f-6f39ef67edb8 for instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 on hv-cinder-85394 Aug 22 17:39:51.890275 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-002571a4-a6f1-4be6-b608-5e789aca6df2 req-0c881522-d691-432b-b289-03433187f0e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034750 Aug 22 17:39:51.891048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 517/1034] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:39:56.390510 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ea5d2c08-5995-4142-a738-4a5e9c5b8c6c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:39:56.391133 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ea5d2c08-5995-4142-a738-4a5e9c5b8c6c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:56.397562 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ea5d2c08-5995-4142-a738-4a5e9c5b8c6c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:56.398120 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ea5d2c08-5995-4142-a738-4a5e9c5b8c6c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:56.398806 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ea5d2c08-5995-4142-a738-4a5e9c5b8c6c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:56.399527 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ea5d2c08-5995-4142-a738-4a5e9c5b8c6c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:56.400603 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ea5d2c08-5995-4142-a738-4a5e9c5b8c6c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:56.401612 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ea5d2c08-5995-4142-a738-4a5e9c5b8c6c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:56.427226 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-ea5d2c08-5995-4142-a738-4a5e9c5b8c6c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lazy-loading 'flavor' on Instance uuid 08c5d826-b574-453f-9bb2-d7d6f8b6bb15 {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:39:56.795863 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ea5d2c08-5995-4142-a738-4a5e9c5b8c6c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "POST /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15/action" status: 202 len: 0 microversion: 2.1 time: 0.410672 Aug 22 17:39:56.796585 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 518/1035] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 22 17:39:56 2022] POST /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:39:56.806127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ea47c8b8-e988-4845-ab95-f742a03468ff tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:56.807225 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ea47c8b8-e988-4845-ab95-f742a03468ff tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:56.816598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea47c8b8-e988-4845-ab95-f742a03468ff tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:56.817220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea47c8b8-e988-4845-ab95-f742a03468ff tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:56.817656 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea47c8b8-e988-4845-ab95-f742a03468ff tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:56.818693 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea47c8b8-e988-4845-ab95-f742a03468ff tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:56.819575 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea47c8b8-e988-4845-ab95-f742a03468ff tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:56.820330 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ea47c8b8-e988-4845-ab95-f742a03468ff tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:56.983286 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ea47c8b8-e988-4845-ab95-f742a03468ff tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:56.994958 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ea47c8b8-e988-4845-ab95-f742a03468ff tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1566 microversion: 2.1 time: 0.193256 Aug 22 17:39:56.996430 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 518/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:56 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1566 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:39:58.021254 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2ff94a4c-deae-4eb5-a87a-d2e381d22336 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:58.022096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-2ff94a4c-deae-4eb5-a87a-d2e381d22336 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:58.030333 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ff94a4c-deae-4eb5-a87a-d2e381d22336 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:58.030861 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ff94a4c-deae-4eb5-a87a-d2e381d22336 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:58.031308 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ff94a4c-deae-4eb5-a87a-d2e381d22336 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:58.032094 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ff94a4c-deae-4eb5-a87a-d2e381d22336 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:58.032554 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ff94a4c-deae-4eb5-a87a-d2e381d22336 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:58.032986 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ff94a4c-deae-4eb5-a87a-d2e381d22336 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:58.232001 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2ff94a4c-deae-4eb5-a87a-d2e381d22336 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:58.240206 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2ff94a4c-deae-4eb5-a87a-d2e381d22336 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1566 microversion: 2.1 time: 0.223372 Aug 22 17:39:58.240792 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 519/1037] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:58 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1566 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:39:59.273550 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-be8ccbe7-3741-48d3-b4ab-d4164781c694 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:39:59.278413 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-be8ccbe7-3741-48d3-b4ab-d4164781c694 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:39:59.281698 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be8ccbe7-3741-48d3-b4ab-d4164781c694 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:59.282204 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be8ccbe7-3741-48d3-b4ab-d4164781c694 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:59.282715 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be8ccbe7-3741-48d3-b4ab-d4164781c694 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:59.283541 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be8ccbe7-3741-48d3-b4ab-d4164781c694 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:39:59.284121 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be8ccbe7-3741-48d3-b4ab-d4164781c694 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:39:59.284731 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be8ccbe7-3741-48d3-b4ab-d4164781c694 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:39:59.452695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-be8ccbe7-3741-48d3-b4ab-d4164781c694 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:39:59.463077 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-be8ccbe7-3741-48d3-b4ab-d4164781c694 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1566 microversion: 2.1 time: 0.193521 Aug 22 17:39:59.463523 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 519/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:39:59 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:00.486645 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b029d08b-ba72-4552-870d-bf28cf5df33e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:00.487435 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b029d08b-ba72-4552-870d-bf28cf5df33e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:00.494418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b029d08b-ba72-4552-870d-bf28cf5df33e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:00.494968 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b029d08b-ba72-4552-870d-bf28cf5df33e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:00.495418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b029d08b-ba72-4552-870d-bf28cf5df33e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:00.496249 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b029d08b-ba72-4552-870d-bf28cf5df33e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:00.496716 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b029d08b-ba72-4552-870d-bf28cf5df33e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:00.497143 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b029d08b-ba72-4552-870d-bf28cf5df33e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:00.672120 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b029d08b-ba72-4552-870d-bf28cf5df33e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:00.682354 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b029d08b-ba72-4552-870d-bf28cf5df33e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1566 microversion: 2.1 time: 0.199821 Aug 22 17:40:00.683211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 520/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:00 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:40:01.704652 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-59f21d3a-2d62-4258-b921-8c4ed761331c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:01.705255 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-59f21d3a-2d62-4258-b921-8c4ed761331c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:01.708237 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:01.714675 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-59f21d3a-2d62-4258-b921-8c4ed761331c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:01.715410 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-59f21d3a-2d62-4258-b921-8c4ed761331c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:01.715889 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-59f21d3a-2d62-4258-b921-8c4ed761331c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:01.716736 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-59f21d3a-2d62-4258-b921-8c4ed761331c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:01.717300 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-59f21d3a-2d62-4258-b921-8c4ed761331c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:01.717825 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-59f21d3a-2d62-4258-b921-8c4ed761331c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:01.721115 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=65 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:01.902077 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-59f21d3a-2d62-4258-b921-8c4ed761331c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:01.917487 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-59f21d3a-2d62-4258-b921-8c4ed761331c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1566 microversion: 2.1 time: 0.216552 Aug 22 17:40:01.918656 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 520/1040] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:01 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1566 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:02.956665 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3d582802-46c8-480f-8e65-a9d44d5e1e9e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:02.957832 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3d582802-46c8-480f-8e65-a9d44d5e1e9e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:02.971277 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3d582802-46c8-480f-8e65-a9d44d5e1e9e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:02.972223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3d582802-46c8-480f-8e65-a9d44d5e1e9e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:02.972995 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3d582802-46c8-480f-8e65-a9d44d5e1e9e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:02.974229 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3d582802-46c8-480f-8e65-a9d44d5e1e9e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:02.975139 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3d582802-46c8-480f-8e65-a9d44d5e1e9e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:02.975892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3d582802-46c8-480f-8e65-a9d44d5e1e9e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:03.153033 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3d582802-46c8-480f-8e65-a9d44d5e1e9e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:03.161535 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3d582802-46c8-480f-8e65-a9d44d5e1e9e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1566 microversion: 2.1 time: 0.212387 Aug 22 17:40:03.168964 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 521/1041] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:02 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1566 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:04.202400 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-9064ff1d-79e2-48dc-8f94-fb51996fbd77 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:04.203713 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9064ff1d-79e2-48dc-8f94-fb51996fbd77 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:04.215765 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9064ff1d-79e2-48dc-8f94-fb51996fbd77 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:04.216448 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9064ff1d-79e2-48dc-8f94-fb51996fbd77 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:04.216700 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9064ff1d-79e2-48dc-8f94-fb51996fbd77 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:04.217385 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9064ff1d-79e2-48dc-8f94-fb51996fbd77 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:04.217840 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9064ff1d-79e2-48dc-8f94-fb51996fbd77 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:04.218277 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9064ff1d-79e2-48dc-8f94-fb51996fbd77 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:04.402444 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-9064ff1d-79e2-48dc-8f94-fb51996fbd77 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:04.415739 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-9064ff1d-79e2-48dc-8f94-fb51996fbd77 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1566 microversion: 2.1 time: 0.220997 Aug 22 17:40:04.416696 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 521/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:04 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1566 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:05.449690 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-7a1f3220-61f4-414a-b4d7-f4d3f9d2ccdb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:05.450571 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-7a1f3220-61f4-414a-b4d7-f4d3f9d2ccdb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:05.457295 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7a1f3220-61f4-414a-b4d7-f4d3f9d2ccdb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:05.457790 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7a1f3220-61f4-414a-b4d7-f4d3f9d2ccdb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:05.458227 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7a1f3220-61f4-414a-b4d7-f4d3f9d2ccdb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:05.458972 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7a1f3220-61f4-414a-b4d7-f4d3f9d2ccdb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:05.459434 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7a1f3220-61f4-414a-b4d7-f4d3f9d2ccdb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:05.459862 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-7a1f3220-61f4-414a-b4d7-f4d3f9d2ccdb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:05.621932 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-7a1f3220-61f4-414a-b4d7-f4d3f9d2ccdb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:05.632055 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-7a1f3220-61f4-414a-b4d7-f4d3f9d2ccdb tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1566 microversion: 2.1 time: 0.186438 Aug 22 17:40:05.632647 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 522/1043] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:05 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1566 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:40:06.654965 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2d31b5d8-e1b4-4c7a-b5d9-39cbfaf2d4fa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:06.655578 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2d31b5d8-e1b4-4c7a-b5d9-39cbfaf2d4fa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:06.662303 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d31b5d8-e1b4-4c7a-b5d9-39cbfaf2d4fa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:06.662828 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d31b5d8-e1b4-4c7a-b5d9-39cbfaf2d4fa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:06.663268 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d31b5d8-e1b4-4c7a-b5d9-39cbfaf2d4fa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:06.663980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d31b5d8-e1b4-4c7a-b5d9-39cbfaf2d4fa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:06.664430 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d31b5d8-e1b4-4c7a-b5d9-39cbfaf2d4fa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:06.664854 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d31b5d8-e1b4-4c7a-b5d9-39cbfaf2d4fa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:06.819704 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2d31b5d8-e1b4-4c7a-b5d9-39cbfaf2d4fa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:06.831161 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2d31b5d8-e1b4-4c7a-b5d9-39cbfaf2d4fa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1566 microversion: 2.1 time: 0.180718 Aug 22 17:40:06.832060 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 522/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:06 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1566 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:07.857767 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-93764f24-b1f1-4389-aa31-c4617420cc4a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:07.858600 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-93764f24-b1f1-4389-aa31-c4617420cc4a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:07.862823 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=32 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:07.869767 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-93764f24-b1f1-4389-aa31-c4617420cc4a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:07.870394 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-93764f24-b1f1-4389-aa31-c4617420cc4a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:07.870898 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-93764f24-b1f1-4389-aa31-c4617420cc4a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:07.871781 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-93764f24-b1f1-4389-aa31-c4617420cc4a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:07.872243 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-93764f24-b1f1-4389-aa31-c4617420cc4a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:07.872669 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-93764f24-b1f1-4389-aa31-c4617420cc4a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:07.877386 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:08.040478 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-93764f24-b1f1-4389-aa31-c4617420cc4a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:08.055056 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-93764f24-b1f1-4389-aa31-c4617420cc4a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1566 microversion: 2.1 time: 0.203782 Aug 22 17:40:08.055815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 523/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:07 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1566 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:09.087201 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-fffc6aa5-51a2-4cd3-944d-fb5580cfacd5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:09.087873 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-fffc6aa5-51a2-4cd3-944d-fb5580cfacd5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:09.094880 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fffc6aa5-51a2-4cd3-944d-fb5580cfacd5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:09.095464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fffc6aa5-51a2-4cd3-944d-fb5580cfacd5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:09.095918 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fffc6aa5-51a2-4cd3-944d-fb5580cfacd5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:09.096605 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fffc6aa5-51a2-4cd3-944d-fb5580cfacd5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:09.097114 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fffc6aa5-51a2-4cd3-944d-fb5580cfacd5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:09.097669 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fffc6aa5-51a2-4cd3-944d-fb5580cfacd5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:09.240984 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-fffc6aa5-51a2-4cd3-944d-fb5580cfacd5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:09.248963 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-fffc6aa5-51a2-4cd3-944d-fb5580cfacd5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1566 microversion: 2.1 time: 0.165787 Aug 22 17:40:09.249594 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 523/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:09 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:40:10.271043 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-aac834e4-5fe7-4d0a-acd0-040f0a6ffecc tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:10.271636 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-aac834e4-5fe7-4d0a-acd0-040f0a6ffecc tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:10.279754 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aac834e4-5fe7-4d0a-acd0-040f0a6ffecc tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:10.280408 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aac834e4-5fe7-4d0a-acd0-040f0a6ffecc tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:10.280854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aac834e4-5fe7-4d0a-acd0-040f0a6ffecc tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:10.281569 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aac834e4-5fe7-4d0a-acd0-040f0a6ffecc tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:10.282032 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aac834e4-5fe7-4d0a-acd0-040f0a6ffecc tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:10.282460 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aac834e4-5fe7-4d0a-acd0-040f0a6ffecc tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:10.433883 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-aac834e4-5fe7-4d0a-acd0-040f0a6ffecc tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:10.442235 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-aac834e4-5fe7-4d0a-acd0-040f0a6ffecc tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1566 microversion: 2.1 time: 0.175063 Aug 22 17:40:10.442859 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 524/1047] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:10 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1566 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:40:11.465243 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b1c00a88-bb1a-4bae-af27-3861449ee49a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:11.465826 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b1c00a88-bb1a-4bae-af27-3861449ee49a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:11.472446 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1c00a88-bb1a-4bae-af27-3861449ee49a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:11.472939 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1c00a88-bb1a-4bae-af27-3861449ee49a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:11.473379 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1c00a88-bb1a-4bae-af27-3861449ee49a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:11.474107 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1c00a88-bb1a-4bae-af27-3861449ee49a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:11.474594 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1c00a88-bb1a-4bae-af27-3861449ee49a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:11.475029 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b1c00a88-bb1a-4bae-af27-3861449ee49a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:11.637428 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b1c00a88-bb1a-4bae-af27-3861449ee49a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:11.646967 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b1c00a88-bb1a-4bae-af27-3861449ee49a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1507 microversion: 2.1 time: 0.185796 Aug 22 17:40:11.647590 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 524/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:11 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:11.682603 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-aa55265c-9f71-4584-8e9a-f6bffb8d9e0c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:40:11.684667 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-aa55265c-9f71-4584-8e9a-f6bffb8d9e0c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:11.697538 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aa55265c-9f71-4584-8e9a-f6bffb8d9e0c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:11.698536 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aa55265c-9f71-4584-8e9a-f6bffb8d9e0c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:11.699342 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aa55265c-9f71-4584-8e9a-f6bffb8d9e0c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:11.700646 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aa55265c-9f71-4584-8e9a-f6bffb8d9e0c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:11.701293 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aa55265c-9f71-4584-8e9a-f6bffb8d9e0c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:11.702080 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aa55265c-9f71-4584-8e9a-f6bffb8d9e0c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:11.753072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-aa55265c-9f71-4584-8e9a-f6bffb8d9e0c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121852) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 22 17:40:12.094382 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-aa55265c-9f71-4584-8e9a-f6bffb8d9e0c tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "POST /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15/action" status: 202 len: 0 microversion: 2.1 time: 0.418596 Aug 22 17:40:12.095240 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 525/1049] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 22 17:40:11 2022] POST /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:40:12.108419 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-dcb38273-811c-496f-9887-0c4c6f43de31 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:12.109378 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-dcb38273-811c-496f-9887-0c4c6f43de31 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:12.122895 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dcb38273-811c-496f-9887-0c4c6f43de31 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:12.122895 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dcb38273-811c-496f-9887-0c4c6f43de31 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:12.122895 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dcb38273-811c-496f-9887-0c4c6f43de31 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:12.122895 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dcb38273-811c-496f-9887-0c4c6f43de31 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:12.129526 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dcb38273-811c-496f-9887-0c4c6f43de31 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:12.129526 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-dcb38273-811c-496f-9887-0c4c6f43de31 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:12.289900 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-dcb38273-811c-496f-9887-0c4c6f43de31 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:12.300661 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-dcb38273-811c-496f-9887-0c4c6f43de31 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1515 microversion: 2.1 time: 0.200344 Aug 22 17:40:12.301257 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 525/1050] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:12 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:13.298528 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-fc7c1b9b-2326-417b-b28f-97d2ed762268 req-73eb1c85-1274-4a46-bcbd-6aaf779c89b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c5d826-b574-453f-9bb2-d7d6f8b6bb15", "name": "network-vif-unplugged", "status": "completed", "tag": "abca211f-f649-45c4-8d69-21154b866c5b"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:40:13.315393 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-fc7c1b9b-2326-417b-b28f-97d2ed762268 req-73eb1c85-1274-4a46-bcbd-6aaf779c89b5 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:13.318515 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-fc7c1b9b-2326-417b-b28f-97d2ed762268 req-73eb1c85-1274-4a46-bcbd-6aaf779c89b5 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:13.318515 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-fc7c1b9b-2326-417b-b28f-97d2ed762268 req-73eb1c85-1274-4a46-bcbd-6aaf779c89b5 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:13.333812 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1b7a9662-4f44-4148-bdc0-5985c1deb9aa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:13.337886 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1b7a9662-4f44-4148-bdc0-5985c1deb9aa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:13.347715 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.compute.server_external_events [req-fc7c1b9b-2326-417b-b28f-97d2ed762268 req-73eb1c85-1274-4a46-bcbd-6aaf779c89b5 service nova] Unable to find a host for instance 08c5d826-b574-453f-9bb2-d7d6f8b6bb15. Dropping event network-vif-unplugged {{(pid=121852) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 22 17:40:13.348646 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-fc7c1b9b-2326-417b-b28f-97d2ed762268 req-73eb1c85-1274-4a46-bcbd-6aaf779c89b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.058020 Aug 22 17:40:13.349413 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 526/1051] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 22 17:40:13.356342 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b7a9662-4f44-4148-bdc0-5985c1deb9aa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:13.356886 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b7a9662-4f44-4148-bdc0-5985c1deb9aa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:13.357541 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b7a9662-4f44-4148-bdc0-5985c1deb9aa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:13.358370 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b7a9662-4f44-4148-bdc0-5985c1deb9aa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:13.359114 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b7a9662-4f44-4148-bdc0-5985c1deb9aa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:13.359788 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1b7a9662-4f44-4148-bdc0-5985c1deb9aa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:13.543047 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1b7a9662-4f44-4148-bdc0-5985c1deb9aa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:13.552017 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1b7a9662-4f44-4148-bdc0-5985c1deb9aa tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1515 microversion: 2.1 time: 0.225288 Aug 22 17:40:13.552944 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 526/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:13 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1515 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:14.576116 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3888f120-d073-45e2-ae51-fcd88107e8df tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:14.576813 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3888f120-d073-45e2-ae51-fcd88107e8df tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:14.584765 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3888f120-d073-45e2-ae51-fcd88107e8df tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:14.585261 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3888f120-d073-45e2-ae51-fcd88107e8df tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:14.585786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3888f120-d073-45e2-ae51-fcd88107e8df tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:14.586541 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3888f120-d073-45e2-ae51-fcd88107e8df tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:14.586994 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3888f120-d073-45e2-ae51-fcd88107e8df tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:14.587418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3888f120-d073-45e2-ae51-fcd88107e8df tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:14.774034 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3888f120-d073-45e2-ae51-fcd88107e8df tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:14.782949 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3888f120-d073-45e2-ae51-fcd88107e8df tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1517 microversion: 2.1 time: 0.212435 Aug 22 17:40:14.783820 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 527/1053] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:14 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1517 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:15.805580 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-13d43350-6897-4f82-a99b-810493203a2a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:15.806531 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-13d43350-6897-4f82-a99b-810493203a2a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:15.813567 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-13d43350-6897-4f82-a99b-810493203a2a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:15.818350 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-13d43350-6897-4f82-a99b-810493203a2a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:15.818350 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-13d43350-6897-4f82-a99b-810493203a2a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:15.818350 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-13d43350-6897-4f82-a99b-810493203a2a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:15.818350 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-13d43350-6897-4f82-a99b-810493203a2a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:15.819421 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-13d43350-6897-4f82-a99b-810493203a2a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:16.016321 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-13d43350-6897-4f82-a99b-810493203a2a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:16.024811 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-13d43350-6897-4f82-a99b-810493203a2a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1573 microversion: 2.1 time: 0.223289 Aug 22 17:40:16.029701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 527/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:15 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1573 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:17.048031 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-077fb8aa-00d0-4b11-9d00-7c70187506f4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:17.048897 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-077fb8aa-00d0-4b11-9d00-7c70187506f4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:17.056041 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-077fb8aa-00d0-4b11-9d00-7c70187506f4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:17.057351 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-077fb8aa-00d0-4b11-9d00-7c70187506f4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:17.057555 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-077fb8aa-00d0-4b11-9d00-7c70187506f4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:17.058266 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-077fb8aa-00d0-4b11-9d00-7c70187506f4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:17.058860 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-077fb8aa-00d0-4b11-9d00-7c70187506f4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:17.059281 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-077fb8aa-00d0-4b11-9d00-7c70187506f4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:17.210412 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-077fb8aa-00d0-4b11-9d00-7c70187506f4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:17.220233 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-077fb8aa-00d0-4b11-9d00-7c70187506f4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1573 microversion: 2.1 time: 0.176043 Aug 22 17:40:17.220831 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 528/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:17 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:18.243733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-69f029f5-700a-42a9-a06e-4346648ff263 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:18.244554 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-69f029f5-700a-42a9-a06e-4346648ff263 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:18.251695 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-69f029f5-700a-42a9-a06e-4346648ff263 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:18.252186 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-69f029f5-700a-42a9-a06e-4346648ff263 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:18.252624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-69f029f5-700a-42a9-a06e-4346648ff263 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:18.253334 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-69f029f5-700a-42a9-a06e-4346648ff263 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:18.253787 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-69f029f5-700a-42a9-a06e-4346648ff263 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:18.254239 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-69f029f5-700a-42a9-a06e-4346648ff263 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:18.421175 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-69f029f5-700a-42a9-a06e-4346648ff263 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:18.431176 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-69f029f5-700a-42a9-a06e-4346648ff263 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1573 microversion: 2.1 time: 0.191687 Aug 22 17:40:18.433014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 528/1056] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:18 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1573 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:40:19.459198 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-993e0530-a8ef-48e0-8064-99a350112e26 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:19.459914 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-993e0530-a8ef-48e0-8064-99a350112e26 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:19.466744 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-993e0530-a8ef-48e0-8064-99a350112e26 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:19.467240 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-993e0530-a8ef-48e0-8064-99a350112e26 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:19.467685 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-993e0530-a8ef-48e0-8064-99a350112e26 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:19.468400 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-993e0530-a8ef-48e0-8064-99a350112e26 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:19.468858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-993e0530-a8ef-48e0-8064-99a350112e26 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:19.469290 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-993e0530-a8ef-48e0-8064-99a350112e26 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:19.628040 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-993e0530-a8ef-48e0-8064-99a350112e26 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:19.636569 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-993e0530-a8ef-48e0-8064-99a350112e26 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1573 microversion: 2.1 time: 0.181368 Aug 22 17:40:19.637264 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 529/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:19 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1573 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:20.659721 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f8fd8c3b-98aa-47ec-9861-69c506be59c9 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:20.660360 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f8fd8c3b-98aa-47ec-9861-69c506be59c9 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:20.669764 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f8fd8c3b-98aa-47ec-9861-69c506be59c9 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:20.670360 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f8fd8c3b-98aa-47ec-9861-69c506be59c9 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:20.670876 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f8fd8c3b-98aa-47ec-9861-69c506be59c9 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:20.671777 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f8fd8c3b-98aa-47ec-9861-69c506be59c9 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:20.672230 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f8fd8c3b-98aa-47ec-9861-69c506be59c9 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:20.672693 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f8fd8c3b-98aa-47ec-9861-69c506be59c9 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:20.818300 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f8fd8c3b-98aa-47ec-9861-69c506be59c9 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:20.827917 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f8fd8c3b-98aa-47ec-9861-69c506be59c9 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1573 microversion: 2.1 time: 0.172510 Aug 22 17:40:20.828570 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 529/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:20 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1573 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:40:21.850626 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c8065dca-7c35-4e13-ab30-c5d5098f9a45 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:21.851326 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c8065dca-7c35-4e13-ab30-c5d5098f9a45 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:21.858580 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8065dca-7c35-4e13-ab30-c5d5098f9a45 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:21.859072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8065dca-7c35-4e13-ab30-c5d5098f9a45 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:21.859539 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8065dca-7c35-4e13-ab30-c5d5098f9a45 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:21.860260 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8065dca-7c35-4e13-ab30-c5d5098f9a45 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:21.860753 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8065dca-7c35-4e13-ab30-c5d5098f9a45 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:21.861189 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8065dca-7c35-4e13-ab30-c5d5098f9a45 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:22.016630 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c8065dca-7c35-4e13-ab30-c5d5098f9a45 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:22.025724 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c8065dca-7c35-4e13-ab30-c5d5098f9a45 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1573 microversion: 2.1 time: 0.178516 Aug 22 17:40:22.026321 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 530/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:21 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1573 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:40:23.051564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-00a52815-4334-4b07-a8e9-26a1093ad7b1 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:23.052181 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-00a52815-4334-4b07-a8e9-26a1093ad7b1 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:23.059611 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-00a52815-4334-4b07-a8e9-26a1093ad7b1 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:23.060156 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-00a52815-4334-4b07-a8e9-26a1093ad7b1 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:23.060594 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-00a52815-4334-4b07-a8e9-26a1093ad7b1 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:23.061288 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-00a52815-4334-4b07-a8e9-26a1093ad7b1 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:23.061733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-00a52815-4334-4b07-a8e9-26a1093ad7b1 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:23.062154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-00a52815-4334-4b07-a8e9-26a1093ad7b1 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:23.211968 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-00a52815-4334-4b07-a8e9-26a1093ad7b1 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:23.221478 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-00a52815-4334-4b07-a8e9-26a1093ad7b1 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1573 microversion: 2.1 time: 0.173734 Aug 22 17:40:23.222079 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 530/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:23 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1573 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:24.248549 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ff6444e1-aad1-4b9f-a368-0b68f44e0ea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:24.249254 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ff6444e1-aad1-4b9f-a368-0b68f44e0ea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:24.256830 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff6444e1-aad1-4b9f-a368-0b68f44e0ea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:24.257678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff6444e1-aad1-4b9f-a368-0b68f44e0ea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:24.258422 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff6444e1-aad1-4b9f-a368-0b68f44e0ea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:24.260277 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff6444e1-aad1-4b9f-a368-0b68f44e0ea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:24.260618 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff6444e1-aad1-4b9f-a368-0b68f44e0ea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:24.261161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ff6444e1-aad1-4b9f-a368-0b68f44e0ea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:24.436046 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ff6444e1-aad1-4b9f-a368-0b68f44e0ea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:24.445778 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ff6444e1-aad1-4b9f-a368-0b68f44e0ea5 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1573 microversion: 2.1 time: 0.201830 Aug 22 17:40:24.446370 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 531/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:24 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1573 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:25.472815 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ada9cb00-1dbc-487b-95e2-58d5ad5b6e48 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:25.473470 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ada9cb00-1dbc-487b-95e2-58d5ad5b6e48 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:25.481350 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ada9cb00-1dbc-487b-95e2-58d5ad5b6e48 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:25.481851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ada9cb00-1dbc-487b-95e2-58d5ad5b6e48 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:25.482290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ada9cb00-1dbc-487b-95e2-58d5ad5b6e48 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:25.483061 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ada9cb00-1dbc-487b-95e2-58d5ad5b6e48 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:25.483527 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ada9cb00-1dbc-487b-95e2-58d5ad5b6e48 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:25.484862 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ada9cb00-1dbc-487b-95e2-58d5ad5b6e48 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:25.637130 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ada9cb00-1dbc-487b-95e2-58d5ad5b6e48 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:25.646463 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ada9cb00-1dbc-487b-95e2-58d5ad5b6e48 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1573 microversion: 2.1 time: 0.177537 Aug 22 17:40:25.647216 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 531/1062] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:25 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1573 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:26.670368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-66b5f105-33e4-450d-9140-00ec2727e968 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:26.670988 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-66b5f105-33e4-450d-9140-00ec2727e968 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:26.678175 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-66b5f105-33e4-450d-9140-00ec2727e968 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:26.678713 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-66b5f105-33e4-450d-9140-00ec2727e968 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:26.679157 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-66b5f105-33e4-450d-9140-00ec2727e968 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:26.679864 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-66b5f105-33e4-450d-9140-00ec2727e968 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:26.680348 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-66b5f105-33e4-450d-9140-00ec2727e968 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:26.681294 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-66b5f105-33e4-450d-9140-00ec2727e968 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:26.849412 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-66b5f105-33e4-450d-9140-00ec2727e968 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:26.859142 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-66b5f105-33e4-450d-9140-00ec2727e968 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1573 microversion: 2.1 time: 0.193572 Aug 22 17:40:26.860134 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 532/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:26 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1573 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:27.887242 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-28270f80-5a7c-4a2a-a2eb-2648207b623f tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:27.889547 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-28270f80-5a7c-4a2a-a2eb-2648207b623f tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:27.902363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28270f80-5a7c-4a2a-a2eb-2648207b623f tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:27.904141 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28270f80-5a7c-4a2a-a2eb-2648207b623f tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:27.904939 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28270f80-5a7c-4a2a-a2eb-2648207b623f tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:27.906376 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28270f80-5a7c-4a2a-a2eb-2648207b623f tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:27.907301 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28270f80-5a7c-4a2a-a2eb-2648207b623f tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:27.908522 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-28270f80-5a7c-4a2a-a2eb-2648207b623f tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:28.128924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-28270f80-5a7c-4a2a-a2eb-2648207b623f tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:28.145611 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-28270f80-5a7c-4a2a-a2eb-2648207b623f tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1573 microversion: 2.1 time: 0.266417 Aug 22 17:40:28.146716 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 532/1064] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:27 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1573 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:40:29.180125 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3b63740e-7994-49cb-80b3-529d6d458610 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:29.180764 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3b63740e-7994-49cb-80b3-529d6d458610 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:29.187729 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3b63740e-7994-49cb-80b3-529d6d458610 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:29.188252 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3b63740e-7994-49cb-80b3-529d6d458610 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:29.188691 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3b63740e-7994-49cb-80b3-529d6d458610 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:29.189395 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3b63740e-7994-49cb-80b3-529d6d458610 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:29.189853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3b63740e-7994-49cb-80b3-529d6d458610 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:29.190281 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3b63740e-7994-49cb-80b3-529d6d458610 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:29.381081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3b63740e-7994-49cb-80b3-529d6d458610 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:29.389948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3b63740e-7994-49cb-80b3-529d6d458610 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1573 microversion: 2.1 time: 0.213622 Aug 22 17:40:29.390619 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 533/1065] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:29 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1573 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:40:29.471573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-531daf26-017f-4911-8091-feee9df32873 req-8a8391a0-d54c-4d7e-89a0-4d61e5876794 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c5d826-b574-453f-9bb2-d7d6f8b6bb15", "name": "network-vif-plugged", "status": "completed", "tag": "abca211f-f649-45c4-8d69-21154b866c5b"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:40:29.486760 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-531daf26-017f-4911-8091-feee9df32873 req-8a8391a0-d54c-4d7e-89a0-4d61e5876794 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:29.487458 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-531daf26-017f-4911-8091-feee9df32873 req-8a8391a0-d54c-4d7e-89a0-4d61e5876794 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:29.488195 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-531daf26-017f-4911-8091-feee9df32873 req-8a8391a0-d54c-4d7e-89a0-4d61e5876794 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:29.510335 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-531daf26-017f-4911-8091-feee9df32873 req-8a8391a0-d54c-4d7e-89a0-4d61e5876794 service nova] Creating event network-vif-plugged:abca211f-f649-45c4-8d69-21154b866c5b for instance 08c5d826-b574-453f-9bb2-d7d6f8b6bb15 on hv-cinder-85394 Aug 22 17:40:29.517744 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-531daf26-017f-4911-8091-feee9df32873 req-8a8391a0-d54c-4d7e-89a0-4d61e5876794 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052030 Aug 22 17:40:29.518343 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 533/1066] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:40:30.413279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0284ecde-6c7e-4935-8c83-5065493e8075 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:30.414026 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0284ecde-6c7e-4935-8c83-5065493e8075 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:30.422013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0284ecde-6c7e-4935-8c83-5065493e8075 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:30.422822 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0284ecde-6c7e-4935-8c83-5065493e8075 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:30.423397 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0284ecde-6c7e-4935-8c83-5065493e8075 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:30.424472 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0284ecde-6c7e-4935-8c83-5065493e8075 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:30.425032 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0284ecde-6c7e-4935-8c83-5065493e8075 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:30.425516 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0284ecde-6c7e-4935-8c83-5065493e8075 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:30.577332 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0284ecde-6c7e-4935-8c83-5065493e8075 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:30.586628 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0284ecde-6c7e-4935-8c83-5065493e8075 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1573 microversion: 2.1 time: 0.177675 Aug 22 17:40:30.588634 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 534/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:30 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1573 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:31.611847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1ad27bb2-a7ff-48f7-862f-32e359cf3fca tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:31.612718 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1ad27bb2-a7ff-48f7-862f-32e359cf3fca tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:31.621121 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ad27bb2-a7ff-48f7-862f-32e359cf3fca tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:31.621121 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ad27bb2-a7ff-48f7-862f-32e359cf3fca tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:31.621585 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ad27bb2-a7ff-48f7-862f-32e359cf3fca tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:31.622199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ad27bb2-a7ff-48f7-862f-32e359cf3fca tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:31.622699 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ad27bb2-a7ff-48f7-862f-32e359cf3fca tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:31.623127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1ad27bb2-a7ff-48f7-862f-32e359cf3fca tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:31.802094 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1ad27bb2-a7ff-48f7-862f-32e359cf3fca tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:31.812585 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1ad27bb2-a7ff-48f7-862f-32e359cf3fca tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1573 microversion: 2.1 time: 0.206574 Aug 22 17:40:31.813166 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 534/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:31 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1573 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:32.838113 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e9eee931-81d2-4e5a-9056-ef37f1301880 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:32.838768 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e9eee931-81d2-4e5a-9056-ef37f1301880 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:32.845741 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9eee931-81d2-4e5a-9056-ef37f1301880 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:32.846239 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9eee931-81d2-4e5a-9056-ef37f1301880 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:32.846714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9eee931-81d2-4e5a-9056-ef37f1301880 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:32.847420 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9eee931-81d2-4e5a-9056-ef37f1301880 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:32.848059 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9eee931-81d2-4e5a-9056-ef37f1301880 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:32.848493 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9eee931-81d2-4e5a-9056-ef37f1301880 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:33.023641 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e9eee931-81d2-4e5a-9056-ef37f1301880 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:33.033225 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e9eee931-81d2-4e5a-9056-ef37f1301880 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1560 microversion: 2.1 time: 0.200205 Aug 22 17:40:33.033880 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 535/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:32 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1560 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:47.963615 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2108940313", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-567724700", "security_groups": [{"name": "tempest-secgroup-smoke-1067862503"}], "block_device_mapping_v2": [{"uuid": "2ae697e7-63cd-422a-b317-24ba5cbd21fd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e1445a90-112c-40f4-a9b4-b117c3489d79"}]}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:40:47.973931 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=29 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:47.974808 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=85 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:48.117152 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.network.neutron [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] validate_networks() for [('e1445a90-112c-40f4-a9b4-b117c3489d79', None, None, None, None, None)] {{(pid=121853) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:40:48.637369 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Flavor limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:40:48.638149 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Image limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:40:48.639003 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Flavor pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:40:48.639469 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Image pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:40:48.640053 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:40:48.652392 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:48.652954 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:48.653332 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:48.654018 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:48.654634 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:48.654930 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:48.675998 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Getting quotas for project 43d4499a9d9f4c00a09c867bb403dd30. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:40:48.681756 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Getting quotas for user aa55b9fade0047c68c2f3f6bf4dfe44e and project 43d4499a9d9f4c00a09c867bb403dd30. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:40:48.766669 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Going to run 1 instances... {{(pid=121853) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:40:48.770922 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2ae697e7-63cd-422a-b317-24ba5cbd21fd',volume_size=None,volume_type=None)] {{(pid=121853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:40:49.335170 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-017b77eb-41a8-450e-a7f5-6cf74f8be479 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.376758 Aug 22 17:40:49.335933 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 535/1070] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:40:47 2022] POST /compute/v2.1/servers => generated 406 bytes in 1378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 22 17:40:49.353425 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-de3de9c8-fb46-4593-9caa-289dad4c2357 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:49.354996 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-de3de9c8-fb46-4593-9caa-289dad4c2357 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:49.361564 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:49.362599 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:49.457068 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-de3de9c8-fb46-4593-9caa-289dad4c2357 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:49.469314 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-de3de9c8-fb46-4593-9caa-289dad4c2357 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1094 microversion: 2.1 time: 0.123643 Aug 22 17:40:49.475983 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 536/1071] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:49 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1094 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:50.505783 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e8ff5d3e-3ca1-4aa4-9d0f-6234ef4952c4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:50.506976 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e8ff5d3e-3ca1-4aa4-9d0f-6234ef4952c4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:50.519521 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e8ff5d3e-3ca1-4aa4-9d0f-6234ef4952c4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:50.520206 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e8ff5d3e-3ca1-4aa4-9d0f-6234ef4952c4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:50.520852 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e8ff5d3e-3ca1-4aa4-9d0f-6234ef4952c4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:50.521754 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e8ff5d3e-3ca1-4aa4-9d0f-6234ef4952c4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:50.522342 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e8ff5d3e-3ca1-4aa4-9d0f-6234ef4952c4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:50.522910 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e8ff5d3e-3ca1-4aa4-9d0f-6234ef4952c4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:50.596770 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e8ff5d3e-3ca1-4aa4-9d0f-6234ef4952c4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:50.611046 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e8ff5d3e-3ca1-4aa4-9d0f-6234ef4952c4 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1144 microversion: 2.1 time: 0.111698 Aug 22 17:40:50.612092 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 536/1072] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:50 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1144 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:51.646881 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-70ad3105-575b-4799-9e2a-90d99c244519 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:51.647576 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-70ad3105-575b-4799-9e2a-90d99c244519 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:51.656414 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-70ad3105-575b-4799-9e2a-90d99c244519 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:51.659068 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-70ad3105-575b-4799-9e2a-90d99c244519 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:51.659068 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-70ad3105-575b-4799-9e2a-90d99c244519 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:51.659068 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-70ad3105-575b-4799-9e2a-90d99c244519 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:51.659068 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-70ad3105-575b-4799-9e2a-90d99c244519 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:51.659497 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-70ad3105-575b-4799-9e2a-90d99c244519 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:51.732109 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-70ad3105-575b-4799-9e2a-90d99c244519 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:51.743660 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-70ad3105-575b-4799-9e2a-90d99c244519 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1192 microversion: 2.1 time: 0.101006 Aug 22 17:40:51.744910 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 537/1073] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:51 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1192 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:52.766350 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-46b12da7-02d4-429e-b73c-a6984075e769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:52.767667 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-46b12da7-02d4-429e-b73c-a6984075e769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:52.775411 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-46b12da7-02d4-429e-b73c-a6984075e769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:52.776180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-46b12da7-02d4-429e-b73c-a6984075e769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:52.776618 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-46b12da7-02d4-429e-b73c-a6984075e769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:52.777354 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-46b12da7-02d4-429e-b73c-a6984075e769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:52.777808 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-46b12da7-02d4-429e-b73c-a6984075e769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:52.778233 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-46b12da7-02d4-429e-b73c-a6984075e769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:52.860551 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-46b12da7-02d4-429e-b73c-a6984075e769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:52.870215 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-46b12da7-02d4-429e-b73c-a6984075e769 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1210 microversion: 2.1 time: 0.108298 Aug 22 17:40:52.870831 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 537/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:52 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1210 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:53.894354 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3a8aa8d1-ff7e-4dce-ac82-994fcad982bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:53.895002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3a8aa8d1-ff7e-4dce-ac82-994fcad982bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:53.902528 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a8aa8d1-ff7e-4dce-ac82-994fcad982bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:53.904154 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a8aa8d1-ff7e-4dce-ac82-994fcad982bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:53.904154 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a8aa8d1-ff7e-4dce-ac82-994fcad982bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:53.904700 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a8aa8d1-ff7e-4dce-ac82-994fcad982bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:53.905263 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a8aa8d1-ff7e-4dce-ac82-994fcad982bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:53.905698 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3a8aa8d1-ff7e-4dce-ac82-994fcad982bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:54.129086 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3a8aa8d1-ff7e-4dce-ac82-994fcad982bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:54.139194 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3a8aa8d1-ff7e-4dce-ac82-994fcad982bc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1278 microversion: 2.1 time: 0.248495 Aug 22 17:40:54.139194 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 538/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:53 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1278 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:54.555338 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-856cf4c0-3ee8-4065-a7d4-c432a9c5e422 req-d092b4cf-2af7-4d27-b6dc-0e5308b70c3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a897de7c-4112-4e8e-90ec-a99ff9d04f3c", "tag": "f80dc6c1-1efb-4d95-959a-7fefba1f99bb"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:40:54.567971 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-856cf4c0-3ee8-4065-a7d4-c432a9c5e422 req-d092b4cf-2af7-4d27-b6dc-0e5308b70c3a service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:54.575702 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-856cf4c0-3ee8-4065-a7d4-c432a9c5e422 req-d092b4cf-2af7-4d27-b6dc-0e5308b70c3a service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:54.575702 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-856cf4c0-3ee8-4065-a7d4-c432a9c5e422 req-d092b4cf-2af7-4d27-b6dc-0e5308b70c3a service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:54.585021 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-856cf4c0-3ee8-4065-a7d4-c432a9c5e422 req-d092b4cf-2af7-4d27-b6dc-0e5308b70c3a service nova] Creating event network-changed:f80dc6c1-1efb-4d95-959a-7fefba1f99bb for instance a897de7c-4112-4e8e-90ec-a99ff9d04f3c on hv-cinder-85394 Aug 22 17:40:54.590643 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-856cf4c0-3ee8-4065-a7d4-c432a9c5e422 req-d092b4cf-2af7-4d27-b6dc-0e5308b70c3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039380 Aug 22 17:40:54.591260 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 538/1076] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:40:55.166546 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ed98162a-f69c-4452-b92c-d166872668c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:55.168843 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ed98162a-f69c-4452-b92c-d166872668c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:55.182369 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ed98162a-f69c-4452-b92c-d166872668c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:55.189846 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ed98162a-f69c-4452-b92c-d166872668c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:55.189846 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ed98162a-f69c-4452-b92c-d166872668c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:55.189846 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ed98162a-f69c-4452-b92c-d166872668c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:55.189846 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ed98162a-f69c-4452-b92c-d166872668c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:55.190468 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ed98162a-f69c-4452-b92c-d166872668c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:55.463208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-ed98162a-f69c-4452-b92c-d166872668c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:55.497601 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ed98162a-f69c-4452-b92c-d166872668c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.332206 Aug 22 17:40:55.513070 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 539/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:55 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:40:56.523070 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-92ce6e02-ea18-40d9-a1a3-44b9c87c5fc0 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:56.524759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-92ce6e02-ea18-40d9-a1a3-44b9c87c5fc0 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:56.532364 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-92ce6e02-ea18-40d9-a1a3-44b9c87c5fc0 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:56.532852 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-92ce6e02-ea18-40d9-a1a3-44b9c87c5fc0 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:56.533286 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-92ce6e02-ea18-40d9-a1a3-44b9c87c5fc0 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:56.534037 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-92ce6e02-ea18-40d9-a1a3-44b9c87c5fc0 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:56.534509 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-92ce6e02-ea18-40d9-a1a3-44b9c87c5fc0 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:56.534949 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-92ce6e02-ea18-40d9-a1a3-44b9c87c5fc0 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:56.688984 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-92ce6e02-ea18-40d9-a1a3-44b9c87c5fc0 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:56.702511 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-92ce6e02-ea18-40d9-a1a3-44b9c87c5fc0 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.180346 Aug 22 17:40:56.702511 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 539/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:56 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:40:57.721119 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9ea6be10-249e-4c02-9025-039884d19608 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:57.721993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9ea6be10-249e-4c02-9025-039884d19608 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:57.729208 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9ea6be10-249e-4c02-9025-039884d19608 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:57.734955 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9ea6be10-249e-4c02-9025-039884d19608 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:57.734955 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9ea6be10-249e-4c02-9025-039884d19608 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:57.734955 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9ea6be10-249e-4c02-9025-039884d19608 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:57.734955 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9ea6be10-249e-4c02-9025-039884d19608 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:57.735574 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9ea6be10-249e-4c02-9025-039884d19608 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:57.890079 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9ea6be10-249e-4c02-9025-039884d19608 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:57.901917 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9ea6be10-249e-4c02-9025-039884d19608 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.185547 Aug 22 17:40:57.902627 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 540/1079] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:57 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:40:58.925273 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a7cb2b62-9b78-4ed1-921e-bad62e8e79df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:40:58.925903 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-a7cb2b62-9b78-4ed1-921e-bad62e8e79df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:40:58.928452 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:58.930042 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=6 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:40:58.935364 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7cb2b62-9b78-4ed1-921e-bad62e8e79df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:58.935858 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7cb2b62-9b78-4ed1-921e-bad62e8e79df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:58.936297 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7cb2b62-9b78-4ed1-921e-bad62e8e79df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:58.937005 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7cb2b62-9b78-4ed1-921e-bad62e8e79df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:40:58.937459 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7cb2b62-9b78-4ed1-921e-bad62e8e79df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:40:58.937885 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-a7cb2b62-9b78-4ed1-921e-bad62e8e79df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:40:59.100967 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-a7cb2b62-9b78-4ed1-921e-bad62e8e79df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:40:59.109787 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a7cb2b62-9b78-4ed1-921e-bad62e8e79df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.190005 Aug 22 17:40:59.110715 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 540/1080] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:40:58 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:00.131708 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-bd40858d-f88e-43c9-a6dd-efe64844739c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:00.132368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-bd40858d-f88e-43c9-a6dd-efe64844739c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:00.135754 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:00.140700 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd40858d-f88e-43c9-a6dd-efe64844739c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:00.141243 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd40858d-f88e-43c9-a6dd-efe64844739c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:00.141730 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd40858d-f88e-43c9-a6dd-efe64844739c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:00.142718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd40858d-f88e-43c9-a6dd-efe64844739c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:00.143220 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd40858d-f88e-43c9-a6dd-efe64844739c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:00.143715 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bd40858d-f88e-43c9-a6dd-efe64844739c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:00.299653 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-bd40858d-f88e-43c9-a6dd-efe64844739c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:00.308087 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-bd40858d-f88e-43c9-a6dd-efe64844739c tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.180367 Aug 22 17:41:00.308711 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 541/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:00 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:01.329575 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-26ec9d8b-8461-4214-afcf-618916ee20e3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:01.330224 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-26ec9d8b-8461-4214-afcf-618916ee20e3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:01.337620 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-26ec9d8b-8461-4214-afcf-618916ee20e3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:01.338160 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-26ec9d8b-8461-4214-afcf-618916ee20e3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:01.338737 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-26ec9d8b-8461-4214-afcf-618916ee20e3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:01.339527 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-26ec9d8b-8461-4214-afcf-618916ee20e3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:01.340023 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-26ec9d8b-8461-4214-afcf-618916ee20e3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:01.340549 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-26ec9d8b-8461-4214-afcf-618916ee20e3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:01.504879 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-26ec9d8b-8461-4214-afcf-618916ee20e3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:01.515279 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-26ec9d8b-8461-4214-afcf-618916ee20e3 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.189724 Aug 22 17:41:01.515989 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 541/1082] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:01 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:02.537329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0bfefa5e-c1c2-49fc-9511-82ba52f58084 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:02.538082 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0bfefa5e-c1c2-49fc-9511-82ba52f58084 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:02.548558 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bfefa5e-c1c2-49fc-9511-82ba52f58084 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:02.549055 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bfefa5e-c1c2-49fc-9511-82ba52f58084 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:02.550516 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bfefa5e-c1c2-49fc-9511-82ba52f58084 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:02.555205 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bfefa5e-c1c2-49fc-9511-82ba52f58084 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:02.555750 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bfefa5e-c1c2-49fc-9511-82ba52f58084 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:02.556219 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0bfefa5e-c1c2-49fc-9511-82ba52f58084 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:02.724663 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0bfefa5e-c1c2-49fc-9511-82ba52f58084 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:02.733306 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0bfefa5e-c1c2-49fc-9511-82ba52f58084 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.199606 Aug 22 17:41:02.734034 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 542/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:02 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:03.755664 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-839dcb08-c7d8-4606-8b94-c8184ff806c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:03.767712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-839dcb08-c7d8-4606-8b94-c8184ff806c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:03.767712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-839dcb08-c7d8-4606-8b94-c8184ff806c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:03.767712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-839dcb08-c7d8-4606-8b94-c8184ff806c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:03.767712 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-839dcb08-c7d8-4606-8b94-c8184ff806c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:03.768150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-839dcb08-c7d8-4606-8b94-c8184ff806c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:03.768150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-839dcb08-c7d8-4606-8b94-c8184ff806c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:03.768150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-839dcb08-c7d8-4606-8b94-c8184ff806c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:03.913919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-839dcb08-c7d8-4606-8b94-c8184ff806c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:03.922873 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-839dcb08-c7d8-4606-8b94-c8184ff806c1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.171264 Aug 22 17:41:03.923474 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 542/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:03 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:04.944913 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c095e81a-3df9-46a7-8c8d-df60cf229d03 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:04.945561 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c095e81a-3df9-46a7-8c8d-df60cf229d03 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:04.952081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c095e81a-3df9-46a7-8c8d-df60cf229d03 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:04.952568 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c095e81a-3df9-46a7-8c8d-df60cf229d03 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:04.952997 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c095e81a-3df9-46a7-8c8d-df60cf229d03 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:04.953694 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c095e81a-3df9-46a7-8c8d-df60cf229d03 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:04.954149 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c095e81a-3df9-46a7-8c8d-df60cf229d03 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:04.954602 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c095e81a-3df9-46a7-8c8d-df60cf229d03 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:05.110822 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c095e81a-3df9-46a7-8c8d-df60cf229d03 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:05.120674 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c095e81a-3df9-46a7-8c8d-df60cf229d03 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.179592 Aug 22 17:41:05.122560 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 543/1085] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:04 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:06.158172 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-65b8f01d-3738-4034-b845-19f38605917a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:06.158873 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-65b8f01d-3738-4034-b845-19f38605917a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:06.166108 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-65b8f01d-3738-4034-b845-19f38605917a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:06.166646 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-65b8f01d-3738-4034-b845-19f38605917a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:06.167086 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-65b8f01d-3738-4034-b845-19f38605917a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:06.167798 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-65b8f01d-3738-4034-b845-19f38605917a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:06.168257 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-65b8f01d-3738-4034-b845-19f38605917a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:06.168689 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-65b8f01d-3738-4034-b845-19f38605917a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:06.330946 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-65b8f01d-3738-4034-b845-19f38605917a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:06.340112 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-65b8f01d-3738-4034-b845-19f38605917a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.186063 Aug 22 17:41:06.340700 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 543/1086] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:06 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:07.361514 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-16cb2237-9e95-4e8a-b421-77abd2feaa30 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:07.362383 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-16cb2237-9e95-4e8a-b421-77abd2feaa30 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:07.369549 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-16cb2237-9e95-4e8a-b421-77abd2feaa30 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:07.370044 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-16cb2237-9e95-4e8a-b421-77abd2feaa30 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:07.370518 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-16cb2237-9e95-4e8a-b421-77abd2feaa30 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:07.371226 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-16cb2237-9e95-4e8a-b421-77abd2feaa30 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:07.371688 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-16cb2237-9e95-4e8a-b421-77abd2feaa30 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:07.372115 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-16cb2237-9e95-4e8a-b421-77abd2feaa30 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:07.540417 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-16cb2237-9e95-4e8a-b421-77abd2feaa30 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:07.549218 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-16cb2237-9e95-4e8a-b421-77abd2feaa30 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.191438 Aug 22 17:41:07.549741 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 544/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:07 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:08.573081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c0b7748f-fa76-4049-8247-762695f5f126 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:08.573797 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c0b7748f-fa76-4049-8247-762695f5f126 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:08.581110 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c0b7748f-fa76-4049-8247-762695f5f126 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:08.581637 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c0b7748f-fa76-4049-8247-762695f5f126 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:08.582156 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c0b7748f-fa76-4049-8247-762695f5f126 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:08.582825 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c0b7748f-fa76-4049-8247-762695f5f126 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:08.583278 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c0b7748f-fa76-4049-8247-762695f5f126 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:08.583706 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c0b7748f-fa76-4049-8247-762695f5f126 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:08.745772 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c0b7748f-fa76-4049-8247-762695f5f126 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:08.761048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c0b7748f-fa76-4049-8247-762695f5f126 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.192543 Aug 22 17:41:08.762113 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 544/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:08 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:09.795227 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3cb4e796-634e-45f7-9e39-0df055f2b6dc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:09.795952 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3cb4e796-634e-45f7-9e39-0df055f2b6dc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:09.803314 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3cb4e796-634e-45f7-9e39-0df055f2b6dc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:09.804558 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3cb4e796-634e-45f7-9e39-0df055f2b6dc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:09.805078 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3cb4e796-634e-45f7-9e39-0df055f2b6dc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:09.805995 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3cb4e796-634e-45f7-9e39-0df055f2b6dc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:09.806599 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3cb4e796-634e-45f7-9e39-0df055f2b6dc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:09.807049 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3cb4e796-634e-45f7-9e39-0df055f2b6dc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:09.950699 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3cb4e796-634e-45f7-9e39-0df055f2b6dc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:09.959167 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3cb4e796-634e-45f7-9e39-0df055f2b6dc tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.167836 Aug 22 17:41:09.959959 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 545/1089] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:09 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:10.637782 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-2c6d1a12-cf1c-43c6-8392-acb34ae9b043 req-eb9a4d11-2e20-478a-bfeb-d61c15cff6c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a897de7c-4112-4e8e-90ec-a99ff9d04f3c", "name": "network-vif-plugged", "status": "completed", "tag": "f80dc6c1-1efb-4d95-959a-7fefba1f99bb"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:41:10.649447 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-2c6d1a12-cf1c-43c6-8392-acb34ae9b043 req-eb9a4d11-2e20-478a-bfeb-d61c15cff6c3 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:10.649929 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-2c6d1a12-cf1c-43c6-8392-acb34ae9b043 req-eb9a4d11-2e20-478a-bfeb-d61c15cff6c3 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:10.650358 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-2c6d1a12-cf1c-43c6-8392-acb34ae9b043 req-eb9a4d11-2e20-478a-bfeb-d61c15cff6c3 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:10.662167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-2c6d1a12-cf1c-43c6-8392-acb34ae9b043 req-eb9a4d11-2e20-478a-bfeb-d61c15cff6c3 service nova] Creating event network-vif-plugged:f80dc6c1-1efb-4d95-959a-7fefba1f99bb for instance a897de7c-4112-4e8e-90ec-a99ff9d04f3c on hv-cinder-85394 Aug 22 17:41:10.669388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-2c6d1a12-cf1c-43c6-8392-acb34ae9b043 req-eb9a4d11-2e20-478a-bfeb-d61c15cff6c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035017 Aug 22 17:41:10.670544 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 545/1090] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:41:10.981579 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-22e3c283-98d6-4841-8b20-07ac47a09eb5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:10.982221 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-22e3c283-98d6-4841-8b20-07ac47a09eb5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:10.992819 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-22e3c283-98d6-4841-8b20-07ac47a09eb5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:10.992819 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-22e3c283-98d6-4841-8b20-07ac47a09eb5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:10.992819 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-22e3c283-98d6-4841-8b20-07ac47a09eb5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:10.992819 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-22e3c283-98d6-4841-8b20-07ac47a09eb5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:10.993318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-22e3c283-98d6-4841-8b20-07ac47a09eb5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:10.993660 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-22e3c283-98d6-4841-8b20-07ac47a09eb5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:11.133524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-22e3c283-98d6-4841-8b20-07ac47a09eb5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:11.141472 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-22e3c283-98d6-4841-8b20-07ac47a09eb5 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.164339 Aug 22 17:41:11.142049 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 546/1091] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:10 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:12.165999 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b6388b58-dc63-4f48-913d-8941d4e770a9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:12.166741 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-b6388b58-dc63-4f48-913d-8941d4e770a9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:12.172881 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b6388b58-dc63-4f48-913d-8941d4e770a9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:12.173456 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b6388b58-dc63-4f48-913d-8941d4e770a9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:12.173789 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b6388b58-dc63-4f48-913d-8941d4e770a9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:12.174510 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b6388b58-dc63-4f48-913d-8941d4e770a9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:12.174979 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b6388b58-dc63-4f48-913d-8941d4e770a9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:12.175459 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-b6388b58-dc63-4f48-913d-8941d4e770a9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:12.315076 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-b6388b58-dc63-4f48-913d-8941d4e770a9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:12.324502 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b6388b58-dc63-4f48-913d-8941d4e770a9 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.164062 Aug 22 17:41:12.325074 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 546/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:12 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:13.347511 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d4fd9ebc-18f4-4090-bfa7-386432b3b680 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:13.353465 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d4fd9ebc-18f4-4090-bfa7-386432b3b680 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:13.358201 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d4fd9ebc-18f4-4090-bfa7-386432b3b680 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:13.359201 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d4fd9ebc-18f4-4090-bfa7-386432b3b680 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:13.359838 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d4fd9ebc-18f4-4090-bfa7-386432b3b680 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:13.361461 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d4fd9ebc-18f4-4090-bfa7-386432b3b680 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:13.362080 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d4fd9ebc-18f4-4090-bfa7-386432b3b680 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:13.363195 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d4fd9ebc-18f4-4090-bfa7-386432b3b680 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:13.509496 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-d4fd9ebc-18f4-4090-bfa7-386432b3b680 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:13.517910 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d4fd9ebc-18f4-4090-bfa7-386432b3b680 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1266 microversion: 2.1 time: 0.175798 Aug 22 17:41:13.518533 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 547/1093] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:13 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:14.540461 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c70aaeab-5015-4517-980f-558f17698948 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:14.541073 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c70aaeab-5015-4517-980f-558f17698948 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:14.547557 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c70aaeab-5015-4517-980f-558f17698948 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:14.548046 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c70aaeab-5015-4517-980f-558f17698948 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:14.548484 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c70aaeab-5015-4517-980f-558f17698948 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:14.549208 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c70aaeab-5015-4517-980f-558f17698948 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:14.549625 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c70aaeab-5015-4517-980f-558f17698948 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:14.550046 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c70aaeab-5015-4517-980f-558f17698948 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:14.697361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c70aaeab-5015-4517-980f-558f17698948 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:14.705622 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c70aaeab-5015-4517-980f-558f17698948 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1453 microversion: 2.1 time: 0.169037 Aug 22 17:41:14.706183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 547/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:14 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:14.727238 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0dc78a92-84a5-4f7d-9aaf-7981c29a9354 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:14.727861 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0dc78a92-84a5-4f7d-9aaf-7981c29a9354 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:14.734414 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0dc78a92-84a5-4f7d-9aaf-7981c29a9354 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:14.735021 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0dc78a92-84a5-4f7d-9aaf-7981c29a9354 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:14.735421 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0dc78a92-84a5-4f7d-9aaf-7981c29a9354 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:14.736146 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0dc78a92-84a5-4f7d-9aaf-7981c29a9354 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:14.736609 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0dc78a92-84a5-4f7d-9aaf-7981c29a9354 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:14.737039 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0dc78a92-84a5-4f7d-9aaf-7981c29a9354 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:14.894345 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0dc78a92-84a5-4f7d-9aaf-7981c29a9354 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:14.904993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0dc78a92-84a5-4f7d-9aaf-7981c29a9354 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1453 microversion: 2.1 time: 0.182362 Aug 22 17:41:14.905584 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 548/1095] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:14 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:17.175258 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-eecc0609-6531-4482-8586-f872ba618d38 req-5525e8e5-24be-4446-bb08-bfc477c60c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a897de7c-4112-4e8e-90ec-a99ff9d04f3c", "tag": "f80dc6c1-1efb-4d95-959a-7fefba1f99bb"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:41:17.186881 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-eecc0609-6531-4482-8586-f872ba618d38 req-5525e8e5-24be-4446-bb08-bfc477c60c98 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:17.187595 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-eecc0609-6531-4482-8586-f872ba618d38 req-5525e8e5-24be-4446-bb08-bfc477c60c98 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:17.188043 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-eecc0609-6531-4482-8586-f872ba618d38 req-5525e8e5-24be-4446-bb08-bfc477c60c98 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:17.208711 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-eecc0609-6531-4482-8586-f872ba618d38 req-5525e8e5-24be-4446-bb08-bfc477c60c98 service nova] Creating event network-changed:f80dc6c1-1efb-4d95-959a-7fefba1f99bb for instance a897de7c-4112-4e8e-90ec-a99ff9d04f3c on hv-cinder-85394 Aug 22 17:41:17.219135 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-eecc0609-6531-4482-8586-f872ba618d38 req-5525e8e5-24be-4446-bb08-bfc477c60c98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047529 Aug 22 17:41:17.220410 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 548/1096] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:41:34.410232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-beb83a51-eb30-47c9-a959-973a7273b8ca tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:34.410954 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-beb83a51-eb30-47c9-a959-973a7273b8ca tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:34.413548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=28 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:34.414367 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=72 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:34.419476 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-beb83a51-eb30-47c9-a959-973a7273b8ca tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:34.426409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-beb83a51-eb30-47c9-a959-973a7273b8ca tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:34.426409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-beb83a51-eb30-47c9-a959-973a7273b8ca tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:34.426409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-beb83a51-eb30-47c9-a959-973a7273b8ca tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:34.426409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-beb83a51-eb30-47c9-a959-973a7273b8ca tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:34.426930 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-beb83a51-eb30-47c9-a959-973a7273b8ca tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:34.448330 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-beb83a51-eb30-47c9-a959-973a7273b8ca tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/ips" status: 200 len: 145 microversion: 2.1 time: 0.042168 Aug 22 17:41:34.448937 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 549/1097] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 22 17:41:34 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:41:36.710334 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:41:36.711261 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Mon Aug 22 17:41:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:41:38.015281 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1daae524-23bd-4baa-8db8-61c35c3ae0fb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "890db92c-f4a7-4a0a-8898-66ef14182c89"}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:41:38.018029 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1daae524-23bd-4baa-8db8-61c35c3ae0fb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:38.020801 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:38.022058 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=68 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:41:38.028533 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1daae524-23bd-4baa-8db8-61c35c3ae0fb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:38.029034 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1daae524-23bd-4baa-8db8-61c35c3ae0fb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:38.029669 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1daae524-23bd-4baa-8db8-61c35c3ae0fb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:38.030409 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1daae524-23bd-4baa-8db8-61c35c3ae0fb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:38.030906 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1daae524-23bd-4baa-8db8-61c35c3ae0fb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:38.031336 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1daae524-23bd-4baa-8db8-61c35c3ae0fb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:39.042313 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1daae524-23bd-4baa-8db8-61c35c3ae0fb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "POST /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.031221 Aug 22 17:41:39.043107 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 549/1098] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 22 17:41:38 2022] POST /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/os-volume_attachments => generated 194 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:41:47.709773 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b139bf65-0a90-41a9-a27c-0c4bd94d2769 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:41:47.717647 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b139bf65-0a90-41a9-a27c-0c4bd94d2769 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:47.718184 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b139bf65-0a90-41a9-a27c-0c4bd94d2769 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:47.718714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b139bf65-0a90-41a9-a27c-0c4bd94d2769 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:47.785865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b139bf65-0a90-41a9-a27c-0c4bd94d2769 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Going to try to stop instance {{(pid=121852) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 22 17:41:48.014307 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b139bf65-0a90-41a9-a27c-0c4bd94d2769 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "POST /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/action" status: 202 len: 0 microversion: 2.1 time: 0.309355 Aug 22 17:41:48.015151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 550/1099] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 22 17:41:47 2022] POST /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:41:48.031039 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ba5eb47a-bc3e-4d32-a9d3-99a0b09ba5ce tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:48.032397 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ba5eb47a-bc3e-4d32-a9d3-99a0b09ba5ce tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:48.041952 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ba5eb47a-bc3e-4d32-a9d3-99a0b09ba5ce tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:48.042710 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ba5eb47a-bc3e-4d32-a9d3-99a0b09ba5ce tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:48.043194 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ba5eb47a-bc3e-4d32-a9d3-99a0b09ba5ce tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:48.044057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ba5eb47a-bc3e-4d32-a9d3-99a0b09ba5ce tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:48.044546 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ba5eb47a-bc3e-4d32-a9d3-99a0b09ba5ce tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:48.045060 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ba5eb47a-bc3e-4d32-a9d3-99a0b09ba5ce tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:48.209479 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-ba5eb47a-bc3e-4d32-a9d3-99a0b09ba5ce tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:48.220715 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ba5eb47a-bc3e-4d32-a9d3-99a0b09ba5ce tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.199455 Aug 22 17:41:48.221433 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 550/1100] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:48 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:49.251866 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f2455afe-149d-4683-88a3-64782e3f6601 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:49.253005 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f2455afe-149d-4683-88a3-64782e3f6601 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:49.265746 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f2455afe-149d-4683-88a3-64782e3f6601 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:49.266663 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f2455afe-149d-4683-88a3-64782e3f6601 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:49.267468 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f2455afe-149d-4683-88a3-64782e3f6601 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:49.269033 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f2455afe-149d-4683-88a3-64782e3f6601 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:49.269890 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f2455afe-149d-4683-88a3-64782e3f6601 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:49.271481 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f2455afe-149d-4683-88a3-64782e3f6601 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:49.496056 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f2455afe-149d-4683-88a3-64782e3f6601 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:49.506371 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f2455afe-149d-4683-88a3-64782e3f6601 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.263859 Aug 22 17:41:49.507193 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 551/1101] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:49 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:50.527877 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f4d700f3-6c50-4a53-ba29-8d775dd2e138 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:50.528493 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f4d700f3-6c50-4a53-ba29-8d775dd2e138 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:50.535337 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f4d700f3-6c50-4a53-ba29-8d775dd2e138 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:50.535822 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f4d700f3-6c50-4a53-ba29-8d775dd2e138 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:50.536873 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f4d700f3-6c50-4a53-ba29-8d775dd2e138 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:50.537836 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f4d700f3-6c50-4a53-ba29-8d775dd2e138 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:50.538287 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f4d700f3-6c50-4a53-ba29-8d775dd2e138 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:50.538736 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f4d700f3-6c50-4a53-ba29-8d775dd2e138 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:50.684859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-f4d700f3-6c50-4a53-ba29-8d775dd2e138 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:50.694455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f4d700f3-6c50-4a53-ba29-8d775dd2e138 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.170356 Aug 22 17:41:50.695068 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 551/1102] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:50 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:41:51.719455 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c8c90070-f3ad-44a6-8f2b-6fe5ba99c56a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:51.720519 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c8c90070-f3ad-44a6-8f2b-6fe5ba99c56a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:51.732744 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8c90070-f3ad-44a6-8f2b-6fe5ba99c56a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:51.733440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8c90070-f3ad-44a6-8f2b-6fe5ba99c56a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:51.734188 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8c90070-f3ad-44a6-8f2b-6fe5ba99c56a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:51.735442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8c90070-f3ad-44a6-8f2b-6fe5ba99c56a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:51.736253 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8c90070-f3ad-44a6-8f2b-6fe5ba99c56a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:51.737288 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c8c90070-f3ad-44a6-8f2b-6fe5ba99c56a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:51.933313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c8c90070-f3ad-44a6-8f2b-6fe5ba99c56a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:51.942011 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c8c90070-f3ad-44a6-8f2b-6fe5ba99c56a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.227967 Aug 22 17:41:51.943182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 552/1103] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:51 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:52.980180 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-75a1494e-26ab-436b-aaa8-b3d7d280995d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:52.980792 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-75a1494e-26ab-436b-aaa8-b3d7d280995d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:52.987909 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-75a1494e-26ab-436b-aaa8-b3d7d280995d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:52.988577 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-75a1494e-26ab-436b-aaa8-b3d7d280995d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:52.991485 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-75a1494e-26ab-436b-aaa8-b3d7d280995d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:52.991485 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-75a1494e-26ab-436b-aaa8-b3d7d280995d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:52.991485 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-75a1494e-26ab-436b-aaa8-b3d7d280995d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:52.991485 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-75a1494e-26ab-436b-aaa8-b3d7d280995d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:53.137316 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-75a1494e-26ab-436b-aaa8-b3d7d280995d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:53.147152 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-75a1494e-26ab-436b-aaa8-b3d7d280995d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.171346 Aug 22 17:41:53.147706 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 552/1104] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:52 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:54.168520 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-220133fc-325f-414d-8878-8822271e3e83 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:54.169316 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-220133fc-325f-414d-8878-8822271e3e83 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:54.176012 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-220133fc-325f-414d-8878-8822271e3e83 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:54.176522 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-220133fc-325f-414d-8878-8822271e3e83 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:54.177034 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-220133fc-325f-414d-8878-8822271e3e83 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:54.177796 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-220133fc-325f-414d-8878-8822271e3e83 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:54.178327 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-220133fc-325f-414d-8878-8822271e3e83 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:54.178733 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-220133fc-325f-414d-8878-8822271e3e83 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:54.329699 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-220133fc-325f-414d-8878-8822271e3e83 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:54.339723 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-220133fc-325f-414d-8878-8822271e3e83 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.175126 Aug 22 17:41:54.340263 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 553/1105] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:54 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:55.362395 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c588c960-fda1-4197-b0f6-4bbcf6a7ab1e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:55.363085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c588c960-fda1-4197-b0f6-4bbcf6a7ab1e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:55.371015 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c588c960-fda1-4197-b0f6-4bbcf6a7ab1e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:55.371506 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c588c960-fda1-4197-b0f6-4bbcf6a7ab1e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:55.371941 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c588c960-fda1-4197-b0f6-4bbcf6a7ab1e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:55.372937 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c588c960-fda1-4197-b0f6-4bbcf6a7ab1e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:55.373391 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c588c960-fda1-4197-b0f6-4bbcf6a7ab1e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:55.373811 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c588c960-fda1-4197-b0f6-4bbcf6a7ab1e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:55.546675 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-c588c960-fda1-4197-b0f6-4bbcf6a7ab1e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:55.556186 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c588c960-fda1-4197-b0f6-4bbcf6a7ab1e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.197622 Aug 22 17:41:55.556773 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 553/1106] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:55 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:56.587371 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0edd48c5-1280-4da4-aa1a-27ad13779bdf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:56.588035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0edd48c5-1280-4da4-aa1a-27ad13779bdf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:56.595711 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0edd48c5-1280-4da4-aa1a-27ad13779bdf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:56.596300 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0edd48c5-1280-4da4-aa1a-27ad13779bdf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:56.596763 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0edd48c5-1280-4da4-aa1a-27ad13779bdf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:56.597506 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0edd48c5-1280-4da4-aa1a-27ad13779bdf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:56.598015 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0edd48c5-1280-4da4-aa1a-27ad13779bdf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:56.598502 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0edd48c5-1280-4da4-aa1a-27ad13779bdf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:56.755629 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0edd48c5-1280-4da4-aa1a-27ad13779bdf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:56.764656 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0edd48c5-1280-4da4-aa1a-27ad13779bdf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.181852 Aug 22 17:41:56.765250 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 554/1107] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:56 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:57.789934 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-be68ca4a-4533-484b-9186-c511f7b148f1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:57.790578 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-be68ca4a-4533-484b-9186-c511f7b148f1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:57.797248 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be68ca4a-4533-484b-9186-c511f7b148f1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:57.797886 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be68ca4a-4533-484b-9186-c511f7b148f1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:57.798323 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be68ca4a-4533-484b-9186-c511f7b148f1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:57.799067 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be68ca4a-4533-484b-9186-c511f7b148f1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:57.799595 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be68ca4a-4533-484b-9186-c511f7b148f1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:57.800023 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be68ca4a-4533-484b-9186-c511f7b148f1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:57.939927 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-be68ca4a-4533-484b-9186-c511f7b148f1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:57.951109 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-be68ca4a-4533-484b-9186-c511f7b148f1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.165833 Aug 22 17:41:57.951686 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 554/1108] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:57 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:41:58.973329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-07c165d7-9bbf-4ea1-9f7f-f24f527f26e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:41:58.974869 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-07c165d7-9bbf-4ea1-9f7f-f24f527f26e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:41:58.982077 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07c165d7-9bbf-4ea1-9f7f-f24f527f26e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:58.982611 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07c165d7-9bbf-4ea1-9f7f-f24f527f26e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:58.983050 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07c165d7-9bbf-4ea1-9f7f-f24f527f26e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:58.983765 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07c165d7-9bbf-4ea1-9f7f-f24f527f26e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:41:58.984220 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07c165d7-9bbf-4ea1-9f7f-f24f527f26e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:41:58.984648 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-07c165d7-9bbf-4ea1-9f7f-f24f527f26e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:41:59.160502 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-07c165d7-9bbf-4ea1-9f7f-f24f527f26e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:41:59.170342 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-07c165d7-9bbf-4ea1-9f7f-f24f527f26e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.200873 Aug 22 17:41:59.170977 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 555/1109] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:41:58 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:42:00.193170 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-51b7e000-7bce-40b7-999d-d14123e9f682 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:00.194018 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-51b7e000-7bce-40b7-999d-d14123e9f682 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:00.201335 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-51b7e000-7bce-40b7-999d-d14123e9f682 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:00.201828 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-51b7e000-7bce-40b7-999d-d14123e9f682 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:00.202269 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-51b7e000-7bce-40b7-999d-d14123e9f682 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:00.203029 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-51b7e000-7bce-40b7-999d-d14123e9f682 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:00.203493 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-51b7e000-7bce-40b7-999d-d14123e9f682 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:00.203916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-51b7e000-7bce-40b7-999d-d14123e9f682 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:00.357888 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-51b7e000-7bce-40b7-999d-d14123e9f682 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:00.367219 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-51b7e000-7bce-40b7-999d-d14123e9f682 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.178998 Aug 22 17:42:00.367807 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 555/1110] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:00 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:42:01.403605 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a1e2ef14-c2d1-4ac4-9373-0291354183ae tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:01.404299 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a1e2ef14-c2d1-4ac4-9373-0291354183ae tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:01.416122 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1e2ef14-c2d1-4ac4-9373-0291354183ae tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:01.416858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1e2ef14-c2d1-4ac4-9373-0291354183ae tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:01.417510 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1e2ef14-c2d1-4ac4-9373-0291354183ae tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:01.418607 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1e2ef14-c2d1-4ac4-9373-0291354183ae tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:01.419333 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1e2ef14-c2d1-4ac4-9373-0291354183ae tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:01.420058 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a1e2ef14-c2d1-4ac4-9373-0291354183ae tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:01.593369 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-a1e2ef14-c2d1-4ac4-9373-0291354183ae tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:01.602214 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a1e2ef14-c2d1-4ac4-9373-0291354183ae tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.204481 Aug 22 17:42:01.602844 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 556/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:01 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:42:02.625183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-bb0e1aab-c08f-4d1e-8ca9-f7afe404bdb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:02.625796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-bb0e1aab-c08f-4d1e-8ca9-f7afe404bdb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:02.633581 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bb0e1aab-c08f-4d1e-8ca9-f7afe404bdb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:02.634072 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bb0e1aab-c08f-4d1e-8ca9-f7afe404bdb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:02.634555 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bb0e1aab-c08f-4d1e-8ca9-f7afe404bdb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:02.635273 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bb0e1aab-c08f-4d1e-8ca9-f7afe404bdb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:02.635732 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bb0e1aab-c08f-4d1e-8ca9-f7afe404bdb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:02.636178 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bb0e1aab-c08f-4d1e-8ca9-f7afe404bdb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:02.794932 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-bb0e1aab-c08f-4d1e-8ca9-f7afe404bdb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:02.805076 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-bb0e1aab-c08f-4d1e-8ca9-f7afe404bdb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.184168 Aug 22 17:42:02.805941 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 556/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:02 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:42:03.827392 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-6c96a8f2-2931-4208-bb30-04134dd90194 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:03.828055 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-6c96a8f2-2931-4208-bb30-04134dd90194 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:03.835607 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c96a8f2-2931-4208-bb30-04134dd90194 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:03.836102 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c96a8f2-2931-4208-bb30-04134dd90194 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:03.836553 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c96a8f2-2931-4208-bb30-04134dd90194 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:03.837250 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c96a8f2-2931-4208-bb30-04134dd90194 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:03.837702 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c96a8f2-2931-4208-bb30-04134dd90194 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:03.838135 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-6c96a8f2-2931-4208-bb30-04134dd90194 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:03.987526 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-6c96a8f2-2931-4208-bb30-04134dd90194 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:03.996552 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-6c96a8f2-2931-4208-bb30-04134dd90194 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.173059 Aug 22 17:42:03.997406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 557/1113] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:03 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:42:05.019544 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-9330aaf2-1c76-4aab-a1d5-9a99b62af97b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:05.020286 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-9330aaf2-1c76-4aab-a1d5-9a99b62af97b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:05.027302 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9330aaf2-1c76-4aab-a1d5-9a99b62af97b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:05.027828 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9330aaf2-1c76-4aab-a1d5-9a99b62af97b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:05.028266 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9330aaf2-1c76-4aab-a1d5-9a99b62af97b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:05.028977 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9330aaf2-1c76-4aab-a1d5-9a99b62af97b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:05.029428 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9330aaf2-1c76-4aab-a1d5-9a99b62af97b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:05.029850 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-9330aaf2-1c76-4aab-a1d5-9a99b62af97b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:05.201925 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-9330aaf2-1c76-4aab-a1d5-9a99b62af97b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:05.212222 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-9330aaf2-1c76-4aab-a1d5-9a99b62af97b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.196575 Aug 22 17:42:05.212817 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 557/1114] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:05 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:42:06.235093 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f1c23dc1-4281-4684-95bb-04cee7907dc9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:06.235719 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f1c23dc1-4281-4684-95bb-04cee7907dc9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:06.243436 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f1c23dc1-4281-4684-95bb-04cee7907dc9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:06.243933 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f1c23dc1-4281-4684-95bb-04cee7907dc9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:06.244399 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f1c23dc1-4281-4684-95bb-04cee7907dc9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:06.245112 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f1c23dc1-4281-4684-95bb-04cee7907dc9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:06.245569 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f1c23dc1-4281-4684-95bb-04cee7907dc9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:06.245993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f1c23dc1-4281-4684-95bb-04cee7907dc9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:06.421653 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f1c23dc1-4281-4684-95bb-04cee7907dc9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:06.432255 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f1c23dc1-4281-4684-95bb-04cee7907dc9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.200903 Aug 22 17:42:06.432854 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 558/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:06 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:42:07.455788 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-6a5b4ca0-5fd3-459f-b902-bd5c3b92e432 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:07.456429 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-6a5b4ca0-5fd3-459f-b902-bd5c3b92e432 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:07.464361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a5b4ca0-5fd3-459f-b902-bd5c3b92e432 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:07.464842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a5b4ca0-5fd3-459f-b902-bd5c3b92e432 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:07.465277 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a5b4ca0-5fd3-459f-b902-bd5c3b92e432 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:07.465984 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a5b4ca0-5fd3-459f-b902-bd5c3b92e432 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:07.466434 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a5b4ca0-5fd3-459f-b902-bd5c3b92e432 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:07.466891 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-6a5b4ca0-5fd3-459f-b902-bd5c3b92e432 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:07.607853 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-6a5b4ca0-5fd3-459f-b902-bd5c3b92e432 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:07.616666 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-6a5b4ca0-5fd3-459f-b902-bd5c3b92e432 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.165374 Aug 22 17:42:07.617453 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 558/1116] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:07 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:42:08.638503 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-613f1ed2-aee4-45b5-b53c-12240848a32b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:08.639221 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-613f1ed2-aee4-45b5-b53c-12240848a32b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:08.648076 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-613f1ed2-aee4-45b5-b53c-12240848a32b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:08.648594 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-613f1ed2-aee4-45b5-b53c-12240848a32b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:08.649043 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-613f1ed2-aee4-45b5-b53c-12240848a32b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:08.649779 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-613f1ed2-aee4-45b5-b53c-12240848a32b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:08.650240 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-613f1ed2-aee4-45b5-b53c-12240848a32b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:08.650715 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-613f1ed2-aee4-45b5-b53c-12240848a32b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:08.804388 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-613f1ed2-aee4-45b5-b53c-12240848a32b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:08.822750 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-613f1ed2-aee4-45b5-b53c-12240848a32b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.187686 Aug 22 17:42:08.823847 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 559/1117] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:08 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:42:09.859670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-fd714e81-023f-49f3-8313-b894f5dcfd89 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:09.860396 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-fd714e81-023f-49f3-8313-b894f5dcfd89 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:09.863199 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=21 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:09.869557 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd714e81-023f-49f3-8313-b894f5dcfd89 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:09.870127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd714e81-023f-49f3-8313-b894f5dcfd89 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:09.876441 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd714e81-023f-49f3-8313-b894f5dcfd89 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:09.876441 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd714e81-023f-49f3-8313-b894f5dcfd89 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:09.876441 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd714e81-023f-49f3-8313-b894f5dcfd89 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:09.876441 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fd714e81-023f-49f3-8313-b894f5dcfd89 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:09.877088 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:10.034920 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-fd714e81-023f-49f3-8313-b894f5dcfd89 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:10.044251 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-fd714e81-023f-49f3-8313-b894f5dcfd89 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1700 microversion: 2.1 time: 0.188550 Aug 22 17:42:10.044903 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 559/1118] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:09 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1700 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:42:10.066058 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-86689a02-4dc6-4bbf-a458-973176f3ec07 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:42:10.075012 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-86689a02-4dc6-4bbf-a458-973176f3ec07 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:10.075682 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-86689a02-4dc6-4bbf-a458-973176f3ec07 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:10.076341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-86689a02-4dc6-4bbf-a458-973176f3ec07 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:10.111237 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-86689a02-4dc6-4bbf-a458-973176f3ec07 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Going to try to start instance {{(pid=121852) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 22 17:42:10.360017 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-86689a02-4dc6-4bbf-a458-973176f3ec07 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "POST /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/action" status: 202 len: 0 microversion: 2.1 time: 0.297773 Aug 22 17:42:10.360648 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 560/1119] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 22 17:42:10 2022] POST /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:42:10.374197 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-fc6d8cd0-e7d3-4e76-97c9-556c6db95cd3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:10.375369 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-fc6d8cd0-e7d3-4e76-97c9-556c6db95cd3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:10.384650 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc6d8cd0-e7d3-4e76-97c9-556c6db95cd3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:10.385138 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc6d8cd0-e7d3-4e76-97c9-556c6db95cd3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:10.385576 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc6d8cd0-e7d3-4e76-97c9-556c6db95cd3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:10.386289 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc6d8cd0-e7d3-4e76-97c9-556c6db95cd3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:10.386791 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc6d8cd0-e7d3-4e76-97c9-556c6db95cd3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:10.387307 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc6d8cd0-e7d3-4e76-97c9-556c6db95cd3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:10.570634 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-fc6d8cd0-e7d3-4e76-97c9-556c6db95cd3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:10.579743 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-fc6d8cd0-e7d3-4e76-97c9-556c6db95cd3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1709 microversion: 2.1 time: 0.213949 Aug 22 17:42:10.580341 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 560/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:10 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1709 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:42:11.624196 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b3575028-de15-477b-9c35-e233a661c3dc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:11.625475 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b3575028-de15-477b-9c35-e233a661c3dc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:11.633446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b3575028-de15-477b-9c35-e233a661c3dc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:11.633958 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b3575028-de15-477b-9c35-e233a661c3dc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:11.634394 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b3575028-de15-477b-9c35-e233a661c3dc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:11.635168 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b3575028-de15-477b-9c35-e233a661c3dc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:11.635692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b3575028-de15-477b-9c35-e233a661c3dc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:11.636116 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b3575028-de15-477b-9c35-e233a661c3dc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:11.809312 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b3575028-de15-477b-9c35-e233a661c3dc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:11.818083 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b3575028-de15-477b-9c35-e233a661c3dc tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1709 microversion: 2.1 time: 0.202030 Aug 22 17:42:11.818899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 561/1121] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:11 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1709 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:42:12.854670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e899bf65-0610-4065-9554-44ff488a7953 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:12.855317 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e899bf65-0610-4065-9554-44ff488a7953 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:12.862245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e899bf65-0610-4065-9554-44ff488a7953 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:12.862784 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e899bf65-0610-4065-9554-44ff488a7953 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:12.863226 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e899bf65-0610-4065-9554-44ff488a7953 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:12.864047 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e899bf65-0610-4065-9554-44ff488a7953 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:12.864501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e899bf65-0610-4065-9554-44ff488a7953 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:12.864931 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e899bf65-0610-4065-9554-44ff488a7953 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:13.019077 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e899bf65-0610-4065-9554-44ff488a7953 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:13.032720 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e899bf65-0610-4065-9554-44ff488a7953 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1713 microversion: 2.1 time: 0.181797 Aug 22 17:42:13.033873 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 561/1122] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:12 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1713 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:42:22.749978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5f2308ec-dbca-4633-b9ba-c7c58547419e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:22.750993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5f2308ec-dbca-4633-b9ba-c7c58547419e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:22.752572 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-e1a0f6a2-b55e-4e81-9d9f-4ec4f8d72693 req-7ec20c0b-c97a-4687-8dea-3e84fd73f74b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08c5d826-b574-453f-9bb2-d7d6f8b6bb15", "tag": "abca211f-f649-45c4-8d69-21154b866c5b"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:42:22.756179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=26 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:22.757238 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:42:22.768821 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-e1a0f6a2-b55e-4e81-9d9f-4ec4f8d72693 req-7ec20c0b-c97a-4687-8dea-3e84fd73f74b service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:22.774333 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-e1a0f6a2-b55e-4e81-9d9f-4ec4f8d72693 req-7ec20c0b-c97a-4687-8dea-3e84fd73f74b service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:22.774333 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-e1a0f6a2-b55e-4e81-9d9f-4ec4f8d72693 req-7ec20c0b-c97a-4687-8dea-3e84fd73f74b service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:22.774617 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5f2308ec-dbca-4633-b9ba-c7c58547419e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:22.774617 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5f2308ec-dbca-4633-b9ba-c7c58547419e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:22.774617 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5f2308ec-dbca-4633-b9ba-c7c58547419e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:22.776228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5f2308ec-dbca-4633-b9ba-c7c58547419e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:22.776376 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5f2308ec-dbca-4633-b9ba-c7c58547419e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:22.777106 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5f2308ec-dbca-4633-b9ba-c7c58547419e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:22.784312 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-e1a0f6a2-b55e-4e81-9d9f-4ec4f8d72693 req-7ec20c0b-c97a-4687-8dea-3e84fd73f74b service nova] Creating event network-changed:abca211f-f649-45c4-8d69-21154b866c5b for instance 08c5d826-b574-453f-9bb2-d7d6f8b6bb15 on hv-cinder-85394 Aug 22 17:42:22.789811 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-e1a0f6a2-b55e-4e81-9d9f-4ec4f8d72693 req-7ec20c0b-c97a-4687-8dea-3e84fd73f74b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044958 Aug 22 17:42:22.790723 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 562/1123] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:42:22.819237 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5f2308ec-dbca-4633-b9ba-c7c58547419e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Going to try to terminate instance {{(pid=121852) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:42:23.127985 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5f2308ec-dbca-4633-b9ba-c7c58547419e tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "DELETE /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 204 len: 0 microversion: 2.1 time: 0.385557 Aug 22 17:42:23.132455 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 562/1124] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:42:22 2022] DELETE /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:42:23.145133 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4d3648b1-b23b-41e4-b1c6-8813a1d6565a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:23.146512 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4d3648b1-b23b-41e4-b1c6-8813a1d6565a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:23.158171 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d3648b1-b23b-41e4-b1c6-8813a1d6565a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:23.158775 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d3648b1-b23b-41e4-b1c6-8813a1d6565a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:23.159556 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d3648b1-b23b-41e4-b1c6-8813a1d6565a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:23.161776 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d3648b1-b23b-41e4-b1c6-8813a1d6565a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:23.162637 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d3648b1-b23b-41e4-b1c6-8813a1d6565a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:23.163321 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4d3648b1-b23b-41e4-b1c6-8813a1d6565a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:23.330124 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4d3648b1-b23b-41e4-b1c6-8813a1d6565a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:23.343147 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4d3648b1-b23b-41e4-b1c6-8813a1d6565a tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1566 microversion: 2.1 time: 0.206633 Aug 22 17:42:23.344116 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 563/1125] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:23 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:42:24.379362 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b1d12def-f254-4245-bb3c-f867b41cfa5d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:24.380661 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b1d12def-f254-4245-bb3c-f867b41cfa5d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:24.390507 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b1d12def-f254-4245-bb3c-f867b41cfa5d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:24.391289 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b1d12def-f254-4245-bb3c-f867b41cfa5d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:24.391975 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b1d12def-f254-4245-bb3c-f867b41cfa5d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:24.393091 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b1d12def-f254-4245-bb3c-f867b41cfa5d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:24.393836 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b1d12def-f254-4245-bb3c-f867b41cfa5d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:24.395104 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b1d12def-f254-4245-bb3c-f867b41cfa5d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:24.647548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b1d12def-f254-4245-bb3c-f867b41cfa5d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:24.656111 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b1d12def-f254-4245-bb3c-f867b41cfa5d tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1566 microversion: 2.1 time: 0.282295 Aug 22 17:42:24.656707 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 563/1126] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:24 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1566 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:42:25.678909 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-bbf90940-e59f-46a5-bdce-e9d9200addd4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:25.782198 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-bbf90940-e59f-46a5-bdce-e9d9200addd4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:25.782198 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbf90940-e59f-46a5-bdce-e9d9200addd4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:25.782198 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbf90940-e59f-46a5-bdce-e9d9200addd4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:25.782198 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbf90940-e59f-46a5-bdce-e9d9200addd4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:25.783276 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbf90940-e59f-46a5-bdce-e9d9200addd4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:25.783276 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbf90940-e59f-46a5-bdce-e9d9200addd4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:25.783276 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbf90940-e59f-46a5-bdce-e9d9200addd4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:25.858502 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-bbf90940-e59f-46a5-bdce-e9d9200addd4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:25.866986 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-bbf90940-e59f-46a5-bdce-e9d9200addd4 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1449 microversion: 2.1 time: 0.192576 Aug 22 17:42:25.867618 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 564/1127] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:25 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1449 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:42:25.991913 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-9d6c1a06-2fb6-48d1-9391-2bad286dc65f req-e23c2d94-55d7-4db4-873f-ae3f6465f62b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08c5d826-b574-453f-9bb2-d7d6f8b6bb15", "name": "network-vif-deleted", "tag": "abca211f-f649-45c4-8d69-21154b866c5b"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:42:26.002629 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9d6c1a06-2fb6-48d1-9391-2bad286dc65f req-e23c2d94-55d7-4db4-873f-ae3f6465f62b service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:26.004152 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9d6c1a06-2fb6-48d1-9391-2bad286dc65f req-e23c2d94-55d7-4db4-873f-ae3f6465f62b service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:26.004152 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-9d6c1a06-2fb6-48d1-9391-2bad286dc65f req-e23c2d94-55d7-4db4-873f-ae3f6465f62b service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:26.017256 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-9d6c1a06-2fb6-48d1-9391-2bad286dc65f req-e23c2d94-55d7-4db4-873f-ae3f6465f62b service nova] Creating event network-vif-deleted:abca211f-f649-45c4-8d69-21154b866c5b for instance 08c5d826-b574-453f-9bb2-d7d6f8b6bb15 on hv-cinder-85394 Aug 22 17:42:26.023921 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-9d6c1a06-2fb6-48d1-9391-2bad286dc65f req-e23c2d94-55d7-4db4-873f-ae3f6465f62b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035657 Aug 22 17:42:26.024541 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 564/1128] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:42:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:42:26.891874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-97b1c88f-b460-4a09-a91f-b9032690eaa6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:26.893271 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-97b1c88f-b460-4a09-a91f-b9032690eaa6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:26.901089 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97b1c88f-b460-4a09-a91f-b9032690eaa6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:26.902908 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97b1c88f-b460-4a09-a91f-b9032690eaa6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:26.902908 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97b1c88f-b460-4a09-a91f-b9032690eaa6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:26.902908 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97b1c88f-b460-4a09-a91f-b9032690eaa6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:26.903219 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97b1c88f-b460-4a09-a91f-b9032690eaa6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:26.903651 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97b1c88f-b460-4a09-a91f-b9032690eaa6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:26.937109 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97b1c88f-b460-4a09-a91f-b9032690eaa6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:26.937588 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97b1c88f-b460-4a09-a91f-b9032690eaa6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:26.938115 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97b1c88f-b460-4a09-a91f-b9032690eaa6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:26.938754 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-97b1c88f-b460-4a09-a91f-b9032690eaa6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lazy-loading 'fault' on Instance uuid 08c5d826-b574-453f-9bb2-d7d6f8b6bb15 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:42:26.982354 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-97b1c88f-b460-4a09-a91f-b9032690eaa6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9454a7a736164ff09382babab30694d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '608e3c25b97f4a75b2a80903a9d5c656', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:42:26.990653 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-97b1c88f-b460-4a09-a91f-b9032690eaa6 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 200 len: 1225 microversion: 2.1 time: 0.102635 Aug 22 17:42:26.995596 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 565/1129] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:26 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 1225 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:42:28.017635 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d706c55c-69b0-4720-9de0-8903c20bfb54 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:28.019161 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d706c55c-69b0-4720-9de0-8903c20bfb54 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] [instance: 08c5d826-b574-453f-9bb2-d7d6f8b6bb15] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:42:28.030625 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d706c55c-69b0-4720-9de0-8903c20bfb54 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:28.031406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d706c55c-69b0-4720-9de0-8903c20bfb54 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:28.032222 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d706c55c-69b0-4720-9de0-8903c20bfb54 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:28.033720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d706c55c-69b0-4720-9de0-8903c20bfb54 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:42:28.035176 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d706c55c-69b0-4720-9de0-8903c20bfb54 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:42:28.035972 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d706c55c-69b0-4720-9de0-8903c20bfb54 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:42:28.063096 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-d706c55c-69b0-4720-9de0-8903c20bfb54 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] HTTP exception thrown: Instance 08c5d826-b574-453f-9bb2-d7d6f8b6bb15 could not be found. Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d706c55c-69b0-4720-9de0-8903c20bfb54 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Request method failure captured: Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 HTTP/1.1 Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA76TaKQCx7NeNt036ON-G4QMbyaDwclBQoZ2RJrX8g7Qz0A_gXadxkuLG7Xpi49tfH_zBVfozWTReOX__yiWVKILjq3Bmp_Sdv_8Ig31w2KW2QRtDNXACiuTEXsJtlHihSlwzPOb_bvlwHgf4hTISIqGxy4RsZHvoRNZ2D9jPSt-cOU Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 608e3c25b97f4a75b2a80903a9d5c656 Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-TestShelveInstance-1078799507 Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:42:28.064989 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:42:28.067809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/608e3c25b97f4a75b2a80903a9d5c656"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/608e3c25b97f4a75b2a80903a9d5c656"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/608e3c25b97f4a75b2a80903a9d5c656"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_608e3c25b97f4a75b2a80903a9d5c656", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:42:28.067809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-TestShelveInstance-1078799507 Aug 22 17:42:28.067809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 608e3c25b97f4a75b2a80903a9d5c656 Aug 22 17:42:28.067809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-TestShelveInstance-1078799507 Aug 22 17:42:28.067809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-TestShelveInstance-1078799507-project Aug 22 17:42:28.067809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:42:28.067809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:42:28.067809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 9454a7a736164ff09382babab30694d8 Aug 22 17:42:28.067809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-TestShelveInstance-1078799507-project Aug 22 17:42:28.067809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:42:28.067809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance 08c5d826-b574-453f-9bb2-d7d6f8b6bb15 could not be found. Aug 22 17:42:28.067809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '08c5d826-b574-453f-9bb2-d7d6f8b6bb15'} Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08c5d826-b574-453f-9bb2-d7d6f8b6bb15 could not be found. Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:42:28.069524 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08c5d826-b574-453f-9bb2-d7d6f8b6bb15 could not be found. Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08c5d826-b574-453f-9bb2-d7d6f8b6bb15 could not be found. Aug 22 17:42:28.072035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:42:28.074192 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d706c55c-69b0-4720-9de0-8903c20bfb54 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Returning 404 to user: Instance 08c5d826-b574-453f-9bb2-d7d6f8b6bb15 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:42:28.074192 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d706c55c-69b0-4720-9de0-8903c20bfb54 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15" status: 404 len: 111 microversion: 2.1 time: 0.058154 Aug 22 17:42:28.074192 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 565/1130] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:42:28 2022] GET /compute/v2.1/servers/08c5d826-b574-453f-9bb2-d7d6f8b6bb15 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:42:28.332929 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-7a6e6e94-1a49-4709-9353-8aa7258d1f99 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] Calling method '.version_select at 0x7f0e5c466ca0>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:42:28.444843 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-7a6e6e94-1a49-4709-9353-8aa7258d1f99 tempest-TestShelveInstance-1078799507 tempest-TestShelveInstance-1078799507-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1343415650" status: 202 len: 0 microversion: 2.1 time: 0.116017 Aug 22 17:42:28.445700 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 566/1131] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Aug 22 17:42:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1343415650 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:42:30.069556 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:42:30.070174 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Mon Aug 22 17:42:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:43:20.355702 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5789c76a-b364-402d-8ab5-11ed1255ff0f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:20.356441 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5789c76a-b364-402d-8ab5-11ed1255ff0f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:20.358192 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:43:20.358858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:43:20.364652 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5789c76a-b364-402d-8ab5-11ed1255ff0f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:20.365142 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5789c76a-b364-402d-8ab5-11ed1255ff0f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:20.365598 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5789c76a-b364-402d-8ab5-11ed1255ff0f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:20.366274 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5789c76a-b364-402d-8ab5-11ed1255ff0f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:20.366765 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5789c76a-b364-402d-8ab5-11ed1255ff0f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:20.372775 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5789c76a-b364-402d-8ab5-11ed1255ff0f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:20.453627 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.objects.instance [None req-5789c76a-b364-402d-8ab5-11ed1255ff0f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lazy-loading 'services' on Instance uuid f3c3789f-b7a2-49c1-a3f1-74819ced4a46 {{(pid=121852) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:43:20.645236 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5789c76a-b364-402d-8ab5-11ed1255ff0f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/os-volume_attachments/890db92c-f4a7-4a0a-8898-66ef14182c89" status: 202 len: 0 microversion: 2.1 time: 0.293349 Aug 22 17:43:20.645844 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 566/1132] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 22 17:43:20 2022] DELETE /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/os-volume_attachments/890db92c-f4a7-4a0a-8898-66ef14182c89 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:43:21.214950 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ab525292-de6e-4b2a-ba27-a781424df8b1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:21.216087 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ab525292-de6e-4b2a-ba27-a781424df8b1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:21.221161 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=39 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:43:21.221830 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:43:21.232286 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ab525292-de6e-4b2a-ba27-a781424df8b1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:21.232928 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ab525292-de6e-4b2a-ba27-a781424df8b1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:21.233370 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ab525292-de6e-4b2a-ba27-a781424df8b1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:21.234075 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ab525292-de6e-4b2a-ba27-a781424df8b1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:21.234562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ab525292-de6e-4b2a-ba27-a781424df8b1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:21.234991 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ab525292-de6e-4b2a-ba27-a781424df8b1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:21.268634 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ab525292-de6e-4b2a-ba27-a781424df8b1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Going to try to terminate instance {{(pid=121853) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:43:21.522175 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-ada2310f-d3d4-4448-b3a1-88be4deaa5d4 req-9c6cc211-d3f7-40b9-aac6-4091a5948e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a897de7c-4112-4e8e-90ec-a99ff9d04f3c", "tag": "f80dc6c1-1efb-4d95-959a-7fefba1f99bb"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:43:21.532894 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-ada2310f-d3d4-4448-b3a1-88be4deaa5d4 req-9c6cc211-d3f7-40b9-aac6-4091a5948e2f service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:21.535970 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-ada2310f-d3d4-4448-b3a1-88be4deaa5d4 req-9c6cc211-d3f7-40b9-aac6-4091a5948e2f service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:21.535970 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-ada2310f-d3d4-4448-b3a1-88be4deaa5d4 req-9c6cc211-d3f7-40b9-aac6-4091a5948e2f service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:21.545555 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-ada2310f-d3d4-4448-b3a1-88be4deaa5d4 req-9c6cc211-d3f7-40b9-aac6-4091a5948e2f service nova] Creating event network-changed:f80dc6c1-1efb-4d95-959a-7fefba1f99bb for instance a897de7c-4112-4e8e-90ec-a99ff9d04f3c on hv-cinder-85394 Aug 22 17:43:21.551441 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-ada2310f-d3d4-4448-b3a1-88be4deaa5d4 req-9c6cc211-d3f7-40b9-aac6-4091a5948e2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.338471 Aug 22 17:43:21.552334 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 567/1133] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:43:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:43:21.583026 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ab525292-de6e-4b2a-ba27-a781424df8b1 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 204 len: 0 microversion: 2.1 time: 0.372263 Aug 22 17:43:21.586953 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 567/1134] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:43:21 2022] DELETE /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:43:21.592560 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9aff686a-033c-48d7-84bc-8907cb1463df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:21.593507 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9aff686a-033c-48d7-84bc-8907cb1463df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:21.601950 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9aff686a-033c-48d7-84bc-8907cb1463df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:21.602733 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9aff686a-033c-48d7-84bc-8907cb1463df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:21.603348 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9aff686a-033c-48d7-84bc-8907cb1463df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:21.604230 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9aff686a-033c-48d7-84bc-8907cb1463df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:21.604681 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9aff686a-033c-48d7-84bc-8907cb1463df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:21.605332 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9aff686a-033c-48d7-84bc-8907cb1463df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:21.762469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9aff686a-033c-48d7-84bc-8907cb1463df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:21.770441 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-f506c120-8dec-4e52-b942-270191923d5f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:43:21.770701 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9aff686a-033c-48d7-84bc-8907cb1463df tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1578 microversion: 2.1 time: 0.182245 Aug 22 17:43:21.774529 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 568/1135] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:21 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:21.776603 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f506c120-8dec-4e52-b942-270191923d5f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:21.777112 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f506c120-8dec-4e52-b942-270191923d5f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:21.777525 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-f506c120-8dec-4e52-b942-270191923d5f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:21.839067 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-f506c120-8dec-4e52-b942-270191923d5f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Going to try to stop instance {{(pid=121853) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 22 17:43:22.053423 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-f506c120-8dec-4e52-b942-270191923d5f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "POST /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/action" status: 202 len: 0 microversion: 2.1 time: 0.287373 Aug 22 17:43:22.054064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 568/1136] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 22 17:43:21 2022] POST /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:43:22.066920 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2ec64fe2-5760-49c3-9f0e-0433d59a250a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:22.067558 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-2ec64fe2-5760-49c3-9f0e-0433d59a250a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:22.074038 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ec64fe2-5760-49c3-9f0e-0433d59a250a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:22.074559 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ec64fe2-5760-49c3-9f0e-0433d59a250a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:22.075000 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ec64fe2-5760-49c3-9f0e-0433d59a250a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:22.075726 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ec64fe2-5760-49c3-9f0e-0433d59a250a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:22.076184 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ec64fe2-5760-49c3-9f0e-0433d59a250a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:22.076613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2ec64fe2-5760-49c3-9f0e-0433d59a250a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:22.215446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2ec64fe2-5760-49c3-9f0e-0433d59a250a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:22.224581 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2ec64fe2-5760-49c3-9f0e-0433d59a250a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1723 microversion: 2.1 time: 0.162181 Aug 22 17:43:22.225168 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 569/1137] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:22 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:22.794002 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-1a47ad40-a1a4-402b-80a8-3018ef865b12 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:22.794740 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-1a47ad40-a1a4-402b-80a8-3018ef865b12 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:22.802043 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1a47ad40-a1a4-402b-80a8-3018ef865b12 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:22.802554 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1a47ad40-a1a4-402b-80a8-3018ef865b12 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:22.803031 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1a47ad40-a1a4-402b-80a8-3018ef865b12 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:22.806376 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1a47ad40-a1a4-402b-80a8-3018ef865b12 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:22.806953 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1a47ad40-a1a4-402b-80a8-3018ef865b12 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:22.807431 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-1a47ad40-a1a4-402b-80a8-3018ef865b12 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:22.960251 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-1a47ad40-a1a4-402b-80a8-3018ef865b12 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:22.968524 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-1a47ad40-a1a4-402b-80a8-3018ef865b12 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1578 microversion: 2.1 time: 0.178718 Aug 22 17:43:22.969202 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 569/1138] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:22 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1578 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:23.245588 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d39be507-876b-442f-bafa-329830231515 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:23.246160 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-d39be507-876b-442f-bafa-329830231515 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:23.253884 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d39be507-876b-442f-bafa-329830231515 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:23.254375 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d39be507-876b-442f-bafa-329830231515 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:23.254837 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d39be507-876b-442f-bafa-329830231515 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:23.255546 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d39be507-876b-442f-bafa-329830231515 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:23.255997 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d39be507-876b-442f-bafa-329830231515 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:23.256419 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-d39be507-876b-442f-bafa-329830231515 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:23.450702 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-d39be507-876b-442f-bafa-329830231515 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:23.461303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d39be507-876b-442f-bafa-329830231515 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1677 microversion: 2.1 time: 0.219793 Aug 22 17:43:23.471342 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 570/1139] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:23 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1677 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:23.927564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-d64a5377-c9f2-4a0c-b7ea-473f1f31a774 req-93172b83-4186-47ff-aadb-34d5e673b0d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a897de7c-4112-4e8e-90ec-a99ff9d04f3c", "name": "network-vif-deleted", "tag": "f80dc6c1-1efb-4d95-959a-7fefba1f99bb"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:43:23.936521 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-d64a5377-c9f2-4a0c-b7ea-473f1f31a774 req-93172b83-4186-47ff-aadb-34d5e673b0d0 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:23.938408 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-d64a5377-c9f2-4a0c-b7ea-473f1f31a774 req-93172b83-4186-47ff-aadb-34d5e673b0d0 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:23.938408 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-d64a5377-c9f2-4a0c-b7ea-473f1f31a774 req-93172b83-4186-47ff-aadb-34d5e673b0d0 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:23.949903 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-d64a5377-c9f2-4a0c-b7ea-473f1f31a774 req-93172b83-4186-47ff-aadb-34d5e673b0d0 service nova] Creating event network-vif-deleted:f80dc6c1-1efb-4d95-959a-7fefba1f99bb for instance a897de7c-4112-4e8e-90ec-a99ff9d04f3c on hv-cinder-85394 Aug 22 17:43:23.955273 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-d64a5377-c9f2-4a0c-b7ea-473f1f31a774 req-93172b83-4186-47ff-aadb-34d5e673b0d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033211 Aug 22 17:43:23.960153 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 570/1140] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:43:23.990090 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b300a726-4b0f-4d4f-b6d4-24f23419609a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:23.990756 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b300a726-4b0f-4d4f-b6d4-24f23419609a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:23.997465 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b300a726-4b0f-4d4f-b6d4-24f23419609a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:24.000537 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b300a726-4b0f-4d4f-b6d4-24f23419609a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:24.000537 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b300a726-4b0f-4d4f-b6d4-24f23419609a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:24.000537 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b300a726-4b0f-4d4f-b6d4-24f23419609a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:24.000537 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b300a726-4b0f-4d4f-b6d4-24f23419609a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:24.001147 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b300a726-4b0f-4d4f-b6d4-24f23419609a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:24.074887 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b300a726-4b0f-4d4f-b6d4-24f23419609a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:24.078807 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b300a726-4b0f-4d4f-b6d4-24f23419609a tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 200 len: 1391 microversion: 2.1 time: 0.093339 Aug 22 17:43:24.079377 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 571/1141] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:23 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 1391 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:24.483706 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-52a958f6-e874-44d2-93a1-428696f85d81 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:24.484318 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-52a958f6-e874-44d2-93a1-428696f85d81 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:24.491768 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52a958f6-e874-44d2-93a1-428696f85d81 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:24.492259 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52a958f6-e874-44d2-93a1-428696f85d81 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:24.492689 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52a958f6-e874-44d2-93a1-428696f85d81 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:24.493385 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52a958f6-e874-44d2-93a1-428696f85d81 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:24.493831 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52a958f6-e874-44d2-93a1-428696f85d81 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:24.494265 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52a958f6-e874-44d2-93a1-428696f85d81 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:24.629054 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-52a958f6-e874-44d2-93a1-428696f85d81 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:24.637192 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-52a958f6-e874-44d2-93a1-428696f85d81 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1677 microversion: 2.1 time: 0.157715 Aug 22 17:43:24.637812 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 571/1142] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:24 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:25.101551 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9d0c299a-c283-41ed-8406-90979d60614d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:25.102185 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9d0c299a-c283-41ed-8406-90979d60614d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: a897de7c-4112-4e8e-90ec-a99ff9d04f3c] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:25.108643 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d0c299a-c283-41ed-8406-90979d60614d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:25.109149 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d0c299a-c283-41ed-8406-90979d60614d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:25.109634 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d0c299a-c283-41ed-8406-90979d60614d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:25.110578 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d0c299a-c283-41ed-8406-90979d60614d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:25.110875 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d0c299a-c283-41ed-8406-90979d60614d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:25.112085 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d0c299a-c283-41ed-8406-90979d60614d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:25.127862 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-9d0c299a-c283-41ed-8406-90979d60614d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] HTTP exception thrown: Instance a897de7c-4112-4e8e-90ec-a99ff9d04f3c could not be found. Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9d0c299a-c283-41ed-8406-90979d60614d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Request method failure captured: Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c HTTP/1.1 Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA74liqewjdrb1wZKL57D_hZWgcYD1SOs8ywPyYhT-ux42-l-CuMJWsVp6WoPh5QalsO8tcFo2_YHRDRmRpm7iLY4OM1hUjdhxXOI5-Vhp6b45jpgOXyF_YeyR2aWN-0d-1bNEF7vdyvieBE57sQWFZrFs78uZFO0SX_JLqZ7u3chpYk Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 43d4499a9d9f4c00a09c867bb403dd30 Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-TestVolumeBootPattern-883724751 Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:43:25.129692 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:43:25.136329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43d4499a9d9f4c00a09c867bb403dd30", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:43:25.136329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-TestVolumeBootPattern-883724751 Aug 22 17:43:25.136329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 43d4499a9d9f4c00a09c867bb403dd30 Aug 22 17:43:25.136329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-TestVolumeBootPattern-883724751 Aug 22 17:43:25.136329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-TestVolumeBootPattern-883724751-project Aug 22 17:43:25.136329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:43:25.136329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:43:25.136329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: aa55b9fade0047c68c2f3f6bf4dfe44e Aug 22 17:43:25.136329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-TestVolumeBootPattern-883724751-project Aug 22 17:43:25.136329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:43:25.136329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance a897de7c-4112-4e8e-90ec-a99ff9d04f3c could not be found. Aug 22 17:43:25.136329 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': 'a897de7c-4112-4e8e-90ec-a99ff9d04f3c'} Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a897de7c-4112-4e8e-90ec-a99ff9d04f3c could not be found. Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:43:25.137341 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a897de7c-4112-4e8e-90ec-a99ff9d04f3c could not be found. Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a897de7c-4112-4e8e-90ec-a99ff9d04f3c could not be found. Aug 22 17:43:25.139548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:43:25.141052 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9d0c299a-c283-41ed-8406-90979d60614d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Returning 404 to user: Instance a897de7c-4112-4e8e-90ec-a99ff9d04f3c could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:43:25.141052 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9d0c299a-c283-41ed-8406-90979d60614d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c" status: 404 len: 111 microversion: 2.1 time: 0.034280 Aug 22 17:43:25.141052 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 572/1143] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:25 2022] GET /compute/v2.1/servers/a897de7c-4112-4e8e-90ec-a99ff9d04f3c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:43:25.660460 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-3c4a957f-827e-4b26-81e5-31059aecbbc6 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:25.661848 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-3c4a957f-827e-4b26-81e5-31059aecbbc6 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:25.668980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3c4a957f-827e-4b26-81e5-31059aecbbc6 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:25.679087 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3c4a957f-827e-4b26-81e5-31059aecbbc6 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:25.679087 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3c4a957f-827e-4b26-81e5-31059aecbbc6 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:25.679087 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3c4a957f-827e-4b26-81e5-31059aecbbc6 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:25.679087 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3c4a957f-827e-4b26-81e5-31059aecbbc6 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:25.679507 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-3c4a957f-827e-4b26-81e5-31059aecbbc6 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:25.829687 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-3c4a957f-827e-4b26-81e5-31059aecbbc6 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:25.838377 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-3c4a957f-827e-4b26-81e5-31059aecbbc6 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1677 microversion: 2.1 time: 0.182635 Aug 22 17:43:25.839229 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 572/1144] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:25 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:26.863760 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-80480e3c-3e25-4703-9947-025673233bde tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:26.864358 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-80480e3c-3e25-4703-9947-025673233bde tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:26.870998 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-80480e3c-3e25-4703-9947-025673233bde tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:26.871483 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-80480e3c-3e25-4703-9947-025673233bde tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:26.871922 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-80480e3c-3e25-4703-9947-025673233bde tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:26.872612 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-80480e3c-3e25-4703-9947-025673233bde tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:26.873064 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-80480e3c-3e25-4703-9947-025673233bde tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:26.873485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-80480e3c-3e25-4703-9947-025673233bde tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:27.006678 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-80480e3c-3e25-4703-9947-025673233bde tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:27.014860 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-80480e3c-3e25-4703-9947-025673233bde tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1677 microversion: 2.1 time: 0.155729 Aug 22 17:43:27.015773 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 573/1145] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:26 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:28.037667 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-bd6a374d-1a2b-446b-8c0c-a718df9d9b25 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:28.038398 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-bd6a374d-1a2b-446b-8c0c-a718df9d9b25 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:28.044890 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd6a374d-1a2b-446b-8c0c-a718df9d9b25 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:28.045370 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd6a374d-1a2b-446b-8c0c-a718df9d9b25 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:28.045813 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd6a374d-1a2b-446b-8c0c-a718df9d9b25 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:28.046523 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd6a374d-1a2b-446b-8c0c-a718df9d9b25 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:28.046976 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd6a374d-1a2b-446b-8c0c-a718df9d9b25 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:28.047393 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bd6a374d-1a2b-446b-8c0c-a718df9d9b25 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:28.290574 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-bd6a374d-1a2b-446b-8c0c-a718df9d9b25 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:28.299896 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-bd6a374d-1a2b-446b-8c0c-a718df9d9b25 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1677 microversion: 2.1 time: 0.266307 Aug 22 17:43:28.300646 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 573/1146] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:28 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1677 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:28.558921 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ebfb82d4-16c4-4e17-8e73-b19fe478698e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:28.559507 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ebfb82d4-16c4-4e17-8e73-b19fe478698e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:28.561466 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-7b03e717-d34e-4bf4-894e-64dcd9d143ee req-67208171-34ee-415c-86ba-0ff716323d6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa975518-469e-47f3-8165-113b27287104", "tag": "20bb2f1b-c55a-4870-b4f7-4b9ad51f76f3"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:43:28.566781 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ebfb82d4-16c4-4e17-8e73-b19fe478698e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:28.567545 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ebfb82d4-16c4-4e17-8e73-b19fe478698e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:28.567993 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ebfb82d4-16c4-4e17-8e73-b19fe478698e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:28.568849 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ebfb82d4-16c4-4e17-8e73-b19fe478698e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:28.569302 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ebfb82d4-16c4-4e17-8e73-b19fe478698e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:28.569724 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ebfb82d4-16c4-4e17-8e73-b19fe478698e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:28.572475 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-7b03e717-d34e-4bf4-894e-64dcd9d143ee req-67208171-34ee-415c-86ba-0ff716323d6d service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:28.573026 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-7b03e717-d34e-4bf4-894e-64dcd9d143ee req-67208171-34ee-415c-86ba-0ff716323d6d service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:28.573534 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-7b03e717-d34e-4bf4-894e-64dcd9d143ee req-67208171-34ee-415c-86ba-0ff716323d6d service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:28.585571 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-7b03e717-d34e-4bf4-894e-64dcd9d143ee req-67208171-34ee-415c-86ba-0ff716323d6d service nova] Creating event network-changed:20bb2f1b-c55a-4870-b4f7-4b9ad51f76f3 for instance fa975518-469e-47f3-8165-113b27287104 on hv-cinder-85394 Aug 22 17:43:28.591159 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-7b03e717-d34e-4bf4-894e-64dcd9d143ee req-67208171-34ee-415c-86ba-0ff716323d6d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033733 Aug 22 17:43:28.591806 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 574/1147] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:43:28.599079 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ebfb82d4-16c4-4e17-8e73-b19fe478698e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Going to try to terminate instance {{(pid=121852) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:43:28.863601 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ebfb82d4-16c4-4e17-8e73-b19fe478698e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 204 len: 0 microversion: 2.1 time: 0.308801 Aug 22 17:43:28.864590 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 574/1148] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:43:28 2022] DELETE /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:43:28.874979 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4155376d-1cb3-4e38-b3f5-f33c66c89f3f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:28.878804 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4155376d-1cb3-4e38-b3f5-f33c66c89f3f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:28.884150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4155376d-1cb3-4e38-b3f5-f33c66c89f3f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:28.884650 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4155376d-1cb3-4e38-b3f5-f33c66c89f3f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:28.885089 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4155376d-1cb3-4e38-b3f5-f33c66c89f3f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:28.885825 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4155376d-1cb3-4e38-b3f5-f33c66c89f3f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:28.886253 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4155376d-1cb3-4e38-b3f5-f33c66c89f3f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:28.886706 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4155376d-1cb3-4e38-b3f5-f33c66c89f3f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:29.239864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4155376d-1cb3-4e38-b3f5-f33c66c89f3f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:29.251201 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4155376d-1cb3-4e38-b3f5-f33c66c89f3f tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1575 microversion: 2.1 time: 0.379061 Aug 22 17:43:29.251201 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 575/1149] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:28 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1575 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:29.322358 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-641da3f6-54fd-4091-8c46-dae9d39b9366 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:29.323102 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-641da3f6-54fd-4091-8c46-dae9d39b9366 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:29.330730 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-641da3f6-54fd-4091-8c46-dae9d39b9366 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:29.331909 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-641da3f6-54fd-4091-8c46-dae9d39b9366 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:29.331909 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-641da3f6-54fd-4091-8c46-dae9d39b9366 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:29.332559 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-641da3f6-54fd-4091-8c46-dae9d39b9366 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:29.333008 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-641da3f6-54fd-4091-8c46-dae9d39b9366 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:29.333432 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-641da3f6-54fd-4091-8c46-dae9d39b9366 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:29.482122 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-641da3f6-54fd-4091-8c46-dae9d39b9366 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:29.500318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-641da3f6-54fd-4091-8c46-dae9d39b9366 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1677 microversion: 2.1 time: 0.182455 Aug 22 17:43:29.501022 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 575/1150] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:29 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1677 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:30.272008 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5c5b1d48-e828-4bcc-a3c0-c12fa2d4ce24 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:30.272621 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5c5b1d48-e828-4bcc-a3c0-c12fa2d4ce24 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:30.279096 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c5b1d48-e828-4bcc-a3c0-c12fa2d4ce24 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:30.279585 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c5b1d48-e828-4bcc-a3c0-c12fa2d4ce24 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:30.280041 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c5b1d48-e828-4bcc-a3c0-c12fa2d4ce24 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:30.280734 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c5b1d48-e828-4bcc-a3c0-c12fa2d4ce24 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:30.281182 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c5b1d48-e828-4bcc-a3c0-c12fa2d4ce24 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:30.281604 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5c5b1d48-e828-4bcc-a3c0-c12fa2d4ce24 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:30.465621 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-5c5b1d48-e828-4bcc-a3c0-c12fa2d4ce24 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:30.473853 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5c5b1d48-e828-4bcc-a3c0-c12fa2d4ce24 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1457 microversion: 2.1 time: 0.206426 Aug 22 17:43:30.476876 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 576/1151] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:30 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1457 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:30.521542 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0f37fb4c-7390-42cb-9c74-cd224259a568 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:30.522858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0f37fb4c-7390-42cb-9c74-cd224259a568 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:30.530083 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0f37fb4c-7390-42cb-9c74-cd224259a568 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:30.530613 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0f37fb4c-7390-42cb-9c74-cd224259a568 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:30.531052 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0f37fb4c-7390-42cb-9c74-cd224259a568 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:30.531774 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0f37fb4c-7390-42cb-9c74-cd224259a568 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:30.532226 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0f37fb4c-7390-42cb-9c74-cd224259a568 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:30.532853 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0f37fb4c-7390-42cb-9c74-cd224259a568 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:30.606229 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-410e6996-7e15-4a60-96d6-8f5598ca1ea3 req-29a27648-e3f0-46d1-9a45-372840773d81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa975518-469e-47f3-8165-113b27287104", "name": "network-vif-deleted", "tag": "20bb2f1b-c55a-4870-b4f7-4b9ad51f76f3"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:43:30.616481 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-410e6996-7e15-4a60-96d6-8f5598ca1ea3 req-29a27648-e3f0-46d1-9a45-372840773d81 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:30.616959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-410e6996-7e15-4a60-96d6-8f5598ca1ea3 req-29a27648-e3f0-46d1-9a45-372840773d81 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:30.617398 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-410e6996-7e15-4a60-96d6-8f5598ca1ea3 req-29a27648-e3f0-46d1-9a45-372840773d81 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:30.630771 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-410e6996-7e15-4a60-96d6-8f5598ca1ea3 req-29a27648-e3f0-46d1-9a45-372840773d81 service nova] Creating event network-vif-deleted:20bb2f1b-c55a-4870-b4f7-4b9ad51f76f3 for instance fa975518-469e-47f3-8165-113b27287104 on hv-cinder-85394 Aug 22 17:43:30.635851 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-410e6996-7e15-4a60-96d6-8f5598ca1ea3 req-29a27648-e3f0-46d1-9a45-372840773d81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033587 Aug 22 17:43:30.637148 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 577/1152] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:43:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:43:30.678644 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0f37fb4c-7390-42cb-9c74-cd224259a568 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:30.686349 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0f37fb4c-7390-42cb-9c74-cd224259a568 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1677 microversion: 2.1 time: 0.168992 Aug 22 17:43:30.686958 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 576/1153] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:30 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:31.495924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-008260cf-7a34-4088-8993-22dd5ee93104 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:31.496549 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-008260cf-7a34-4088-8993-22dd5ee93104 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:31.504217 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-008260cf-7a34-4088-8993-22dd5ee93104 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:31.504903 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-008260cf-7a34-4088-8993-22dd5ee93104 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:31.505178 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-008260cf-7a34-4088-8993-22dd5ee93104 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:31.505702 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-008260cf-7a34-4088-8993-22dd5ee93104 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:31.506365 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-008260cf-7a34-4088-8993-22dd5ee93104 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:31.507213 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-008260cf-7a34-4088-8993-22dd5ee93104 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:31.537996 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-008260cf-7a34-4088-8993-22dd5ee93104 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:31.538499 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-008260cf-7a34-4088-8993-22dd5ee93104 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:31.538950 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-008260cf-7a34-4088-8993-22dd5ee93104 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:31.539403 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-008260cf-7a34-4088-8993-22dd5ee93104 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lazy-loading 'fault' on Instance uuid fa975518-469e-47f3-8165-113b27287104 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:43:31.585653 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-008260cf-7a34-4088-8993-22dd5ee93104 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa55b9fade0047c68c2f3f6bf4dfe44e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43d4499a9d9f4c00a09c867bb403dd30', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:31.593571 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-008260cf-7a34-4088-8993-22dd5ee93104 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 200 len: 1229 microversion: 2.1 time: 0.102167 Aug 22 17:43:31.594148 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 578/1154] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:31 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 1229 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:31.708636 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-36de4d04-421b-44b7-8c2c-6b776db8e5d1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:31.709251 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-36de4d04-421b-44b7-8c2c-6b776db8e5d1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:31.715756 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-36de4d04-421b-44b7-8c2c-6b776db8e5d1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:31.716240 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-36de4d04-421b-44b7-8c2c-6b776db8e5d1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:31.716682 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-36de4d04-421b-44b7-8c2c-6b776db8e5d1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:31.717381 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-36de4d04-421b-44b7-8c2c-6b776db8e5d1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:31.717829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-36de4d04-421b-44b7-8c2c-6b776db8e5d1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:31.718253 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-36de4d04-421b-44b7-8c2c-6b776db8e5d1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:31.864946 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-36de4d04-421b-44b7-8c2c-6b776db8e5d1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:31.873706 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-36de4d04-421b-44b7-8c2c-6b776db8e5d1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1677 microversion: 2.1 time: 0.168881 Aug 22 17:43:31.874292 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 577/1155] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:31 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:32.539597 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:43:32.540234 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Mon Aug 22 17:43:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:43:32.615725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-bbc07597-22da-43cd-8943-a4c95916510b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:32.616530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-bbc07597-22da-43cd-8943-a4c95916510b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: fa975518-469e-47f3-8165-113b27287104] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:32.623313 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbc07597-22da-43cd-8943-a4c95916510b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:32.623788 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbc07597-22da-43cd-8943-a4c95916510b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:32.624482 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbc07597-22da-43cd-8943-a4c95916510b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:32.624879 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbc07597-22da-43cd-8943-a4c95916510b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:32.625321 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbc07597-22da-43cd-8943-a4c95916510b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:32.625738 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-bbc07597-22da-43cd-8943-a4c95916510b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:32.639437 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-bbc07597-22da-43cd-8943-a4c95916510b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] HTTP exception thrown: Instance fa975518-469e-47f3-8165-113b27287104 could not be found. Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-bbc07597-22da-43cd-8943-a4c95916510b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Request method failure captured: Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 HTTP/1.1 Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA74liqewjdrb1wZKL57D_hZWgcYD1SOs8ywPyYhT-ux42-l-CuMJWsVp6WoPh5QalsO8tcFo2_YHRDRmRpm7iLY4OM1hUjdhxXOI5-Vhp6b45jpgOXyF_YeyR2aWN-0d-1bNEF7vdyvieBE57sQWFZrFs78uZFO0SX_JLqZ7u3chpYk Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 43d4499a9d9f4c00a09c867bb403dd30 Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-TestVolumeBootPattern-883724751 Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:43:32.641057 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:43:32.642867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43d4499a9d9f4c00a09c867bb403dd30", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:43:32.642867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-TestVolumeBootPattern-883724751 Aug 22 17:43:32.642867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 43d4499a9d9f4c00a09c867bb403dd30 Aug 22 17:43:32.642867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-TestVolumeBootPattern-883724751 Aug 22 17:43:32.642867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-TestVolumeBootPattern-883724751-project Aug 22 17:43:32.642867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:43:32.642867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:43:32.642867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: aa55b9fade0047c68c2f3f6bf4dfe44e Aug 22 17:43:32.642867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-TestVolumeBootPattern-883724751-project Aug 22 17:43:32.642867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:43:32.642867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance fa975518-469e-47f3-8165-113b27287104 could not be found. Aug 22 17:43:32.642867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': 'fa975518-469e-47f3-8165-113b27287104'} Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa975518-469e-47f3-8165-113b27287104 could not be found. Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:43:32.644167 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa975518-469e-47f3-8165-113b27287104 could not be found. Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa975518-469e-47f3-8165-113b27287104 could not be found. Aug 22 17:43:32.646020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:43:32.647564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-bbc07597-22da-43cd-8943-a4c95916510b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Returning 404 to user: Instance fa975518-469e-47f3-8165-113b27287104 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:43:32.647564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-bbc07597-22da-43cd-8943-a4c95916510b tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104" status: 404 len: 111 microversion: 2.1 time: 0.031391 Aug 22 17:43:32.647564 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 579/1156] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:32 2022] GET /compute/v2.1/servers/fa975518-469e-47f3-8165-113b27287104 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:43:32.895620 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-62b44abc-1bc6-451e-9329-09aaae6cd026 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:32.896239 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-62b44abc-1bc6-451e-9329-09aaae6cd026 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:32.902756 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-62b44abc-1bc6-451e-9329-09aaae6cd026 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:32.903253 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-62b44abc-1bc6-451e-9329-09aaae6cd026 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:32.903689 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-62b44abc-1bc6-451e-9329-09aaae6cd026 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:32.904385 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-62b44abc-1bc6-451e-9329-09aaae6cd026 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:32.904836 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-62b44abc-1bc6-451e-9329-09aaae6cd026 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:32.905257 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-62b44abc-1bc6-451e-9329-09aaae6cd026 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:33.047884 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-62b44abc-1bc6-451e-9329-09aaae6cd026 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:33.058318 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-62b44abc-1bc6-451e-9329-09aaae6cd026 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1677 microversion: 2.1 time: 0.167350 Aug 22 17:43:33.058929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 578/1157] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:32 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:33.176909 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-83fa9a87-ae82-4f72-839f-89988256dd9d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:33.181323 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-83fa9a87-ae82-4f72-839f-89988256dd9d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:33.183670 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-83fa9a87-ae82-4f72-839f-89988256dd9d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:33.184156 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-83fa9a87-ae82-4f72-839f-89988256dd9d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:33.184597 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-83fa9a87-ae82-4f72-839f-89988256dd9d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:33.185292 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-83fa9a87-ae82-4f72-839f-89988256dd9d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:33.185786 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-83fa9a87-ae82-4f72-839f-89988256dd9d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:33.186208 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-83fa9a87-ae82-4f72-839f-89988256dd9d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:33.200503 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-83fa9a87-ae82-4f72-839f-89988256dd9d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] HTTP exception thrown: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-83fa9a87-ae82-4f72-839f-89988256dd9d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Request method failure captured: Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: DELETE /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da HTTP/1.1 Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA74liqewjdrb1wZKL57D_hZWgcYD1SOs8ywPyYhT-ux42-l-CuMJWsVp6WoPh5QalsO8tcFo2_YHRDRmRpm7iLY4OM1hUjdhxXOI5-Vhp6b45jpgOXyF_YeyR2aWN-0d-1bNEF7vdyvieBE57sQWFZrFs78uZFO0SX_JLqZ7u3chpYk Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 43d4499a9d9f4c00a09c867bb403dd30 Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-TestVolumeBootPattern-883724751 Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:43:33.202081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:43:33.203725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43d4499a9d9f4c00a09c867bb403dd30", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:43:33.203725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-TestVolumeBootPattern-883724751 Aug 22 17:43:33.203725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 43d4499a9d9f4c00a09c867bb403dd30 Aug 22 17:43:33.203725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-TestVolumeBootPattern-883724751 Aug 22 17:43:33.203725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-TestVolumeBootPattern-883724751-project Aug 22 17:43:33.203725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:43:33.203725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:43:33.203725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: aa55b9fade0047c68c2f3f6bf4dfe44e Aug 22 17:43:33.203725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-TestVolumeBootPattern-883724751-project Aug 22 17:43:33.203725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:43:33.203725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:43:33.203725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': '2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da'} Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:43:33.204855 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:43:33.206849 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:43:33.208514 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-83fa9a87-ae82-4f72-839f-89988256dd9d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Returning 404 to user: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:43:33.208514 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-83fa9a87-ae82-4f72-839f-89988256dd9d tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 404 len: 111 microversion: 2.1 time: 0.031231 Aug 22 17:43:33.208514 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 580/1158] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:43:33 2022] DELETE /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:43:33.212497 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-776564a0-1837-47ae-9326-b6ab11322e0e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:33.213118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-776564a0-1837-47ae-9326-b6ab11322e0e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] [instance: 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:33.219423 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-776564a0-1837-47ae-9326-b6ab11322e0e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:33.219914 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-776564a0-1837-47ae-9326-b6ab11322e0e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:33.221010 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-776564a0-1837-47ae-9326-b6ab11322e0e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:33.221842 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-776564a0-1837-47ae-9326-b6ab11322e0e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:33.222299 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-776564a0-1837-47ae-9326-b6ab11322e0e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:33.222751 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-776564a0-1837-47ae-9326-b6ab11322e0e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:33.237552 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-776564a0-1837-47ae-9326-b6ab11322e0e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] HTTP exception thrown: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-776564a0-1837-47ae-9326-b6ab11322e0e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Request method failure captured: Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da HTTP/1.1 Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA74liqewjdrb1wZKL57D_hZWgcYD1SOs8ywPyYhT-ux42-l-CuMJWsVp6WoPh5QalsO8tcFo2_YHRDRmRpm7iLY4OM1hUjdhxXOI5-Vhp6b45jpgOXyF_YeyR2aWN-0d-1bNEF7vdyvieBE57sQWFZrFs78uZFO0SX_JLqZ7u3chpYk Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 43d4499a9d9f4c00a09c867bb403dd30 Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-TestVolumeBootPattern-883724751 Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:43:33.239336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:43:33.241279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/43d4499a9d9f4c00a09c867bb403dd30"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_43d4499a9d9f4c00a09c867bb403dd30", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:43:33.241279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-TestVolumeBootPattern-883724751 Aug 22 17:43:33.241279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 43d4499a9d9f4c00a09c867bb403dd30 Aug 22 17:43:33.241279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-TestVolumeBootPattern-883724751 Aug 22 17:43:33.241279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-TestVolumeBootPattern-883724751-project Aug 22 17:43:33.241279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:43:33.241279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:43:33.241279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: aa55b9fade0047c68c2f3f6bf4dfe44e Aug 22 17:43:33.241279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-TestVolumeBootPattern-883724751-project Aug 22 17:43:33.241279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:43:33.241279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:43:33.241279 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da'} Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:43:33.242737 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. Aug 22 17:43:33.244718 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:43:33.246125 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-776564a0-1837-47ae-9326-b6ab11322e0e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Returning 404 to user: Instance 2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:43:33.246125 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-776564a0-1837-47ae-9326-b6ab11322e0e tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da" status: 404 len: 111 microversion: 2.1 time: 0.032179 Aug 22 17:43:33.246125 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 579/1159] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:33 2022] GET /compute/v2.1/servers/2eac2b0b-ed7d-4b5d-b2c1-bac80cc9b2da => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:43:34.081326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cae7a4f0-3402-4906-958c-f6b13b4b9f5a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:34.081925 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-cae7a4f0-3402-4906-958c-f6b13b4b9f5a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:34.088515 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cae7a4f0-3402-4906-958c-f6b13b4b9f5a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:34.088999 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cae7a4f0-3402-4906-958c-f6b13b4b9f5a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:34.089432 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cae7a4f0-3402-4906-958c-f6b13b4b9f5a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:34.090158 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cae7a4f0-3402-4906-958c-f6b13b4b9f5a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:34.090640 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cae7a4f0-3402-4906-958c-f6b13b4b9f5a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:34.091062 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cae7a4f0-3402-4906-958c-f6b13b4b9f5a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:34.232107 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-cae7a4f0-3402-4906-958c-f6b13b4b9f5a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:34.240694 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-cae7a4f0-3402-4906-958c-f6b13b4b9f5a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1654 microversion: 2.1 time: 0.163862 Aug 22 17:43:34.241276 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 581/1160] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:34 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1654 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:34.261514 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a6b438c2-69a1-4b96-8fe7-2183e1b7416f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:43:34.269314 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6b438c2-69a1-4b96-8fe7-2183e1b7416f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:34.269806 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6b438c2-69a1-4b96-8fe7-2183e1b7416f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:34.270247 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a6b438c2-69a1-4b96-8fe7-2183e1b7416f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:34.300286 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a6b438c2-69a1-4b96-8fe7-2183e1b7416f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Going to try to start instance {{(pid=121852) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 22 17:43:34.502104 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a6b438c2-69a1-4b96-8fe7-2183e1b7416f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "POST /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/action" status: 202 len: 0 microversion: 2.1 time: 0.242599 Aug 22 17:43:34.502104 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 580/1161] 10.222.0.20 () {60 vars in 1278 bytes} [Mon Aug 22 17:43:34 2022] POST /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:43:34.509843 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-52ac0c08-04c7-4eaa-a6b5-896e79b22385 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:34.510576 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-52ac0c08-04c7-4eaa-a6b5-896e79b22385 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:34.517675 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52ac0c08-04c7-4eaa-a6b5-896e79b22385 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:34.518261 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52ac0c08-04c7-4eaa-a6b5-896e79b22385 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:34.518779 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52ac0c08-04c7-4eaa-a6b5-896e79b22385 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:34.519493 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52ac0c08-04c7-4eaa-a6b5-896e79b22385 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:34.519949 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52ac0c08-04c7-4eaa-a6b5-896e79b22385 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:34.520375 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-52ac0c08-04c7-4eaa-a6b5-896e79b22385 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:34.670867 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-52ac0c08-04c7-4eaa-a6b5-896e79b22385 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:34.679572 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-52ac0c08-04c7-4eaa-a6b5-896e79b22385 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1663 microversion: 2.1 time: 0.173466 Aug 22 17:43:34.680565 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 582/1162] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:34 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1663 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:43:34.754307 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-51bcaedc-c7c8-4f95-a84d-1ecb93eac776 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] Calling method '.version_select at 0x7f0e5d0a71f0>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:34.823264 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-51bcaedc-c7c8-4f95-a84d-1ecb93eac776 tempest-TestVolumeBootPattern-883724751 tempest-TestVolumeBootPattern-883724751-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-567724700" status: 202 len: 0 microversion: 2.1 time: 0.073942 Aug 22 17:43:34.823862 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 581/1163] 10.222.0.20 () {58 vars in 1260 bytes} [Mon Aug 22 17:43:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-567724700 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:43:35.701127 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-7a351f93-293e-4c75-82d7-e096d3fb97e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:35.701759 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-7a351f93-293e-4c75-82d7-e096d3fb97e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:35.709064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7a351f93-293e-4c75-82d7-e096d3fb97e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:35.709553 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7a351f93-293e-4c75-82d7-e096d3fb97e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:35.709988 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7a351f93-293e-4c75-82d7-e096d3fb97e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:35.710714 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7a351f93-293e-4c75-82d7-e096d3fb97e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:35.711222 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7a351f93-293e-4c75-82d7-e096d3fb97e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:35.711694 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7a351f93-293e-4c75-82d7-e096d3fb97e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:35.844399 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7a351f93-293e-4c75-82d7-e096d3fb97e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:35.848830 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:43:35.853397 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-7a351f93-293e-4c75-82d7-e096d3fb97e5 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1663 microversion: 2.1 time: 0.156095 Aug 22 17:43:35.853980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 583/1164] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:35 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1663 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:43:36.876414 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9d007d5a-ae9e-4a98-904c-87348ca51fe3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:43:36.878538 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9d007d5a-ae9e-4a98-904c-87348ca51fe3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:43:36.885479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d007d5a-ae9e-4a98-904c-87348ca51fe3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:36.886103 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d007d5a-ae9e-4a98-904c-87348ca51fe3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:36.886694 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d007d5a-ae9e-4a98-904c-87348ca51fe3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:36.887539 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d007d5a-ae9e-4a98-904c-87348ca51fe3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:43:36.888126 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d007d5a-ae9e-4a98-904c-87348ca51fe3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:43:36.888646 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d007d5a-ae9e-4a98-904c-87348ca51fe3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:43:36.895724 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:43:37.051198 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-9d007d5a-ae9e-4a98-904c-87348ca51fe3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:43:37.060419 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9d007d5a-ae9e-4a98-904c-87348ca51fe3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1667 microversion: 2.1 time: 0.188735 Aug 22 17:43:37.061464 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 582/1165] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:43:36 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1667 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:44:40.472886 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:44:40.477271 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-ae315ca6-e082-43af-b47e-98df3a5edec4 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:40.480086 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-ae315ca6-e082-43af-b47e-98df3a5edec4 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:40.489460 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ae315ca6-e082-43af-b47e-98df3a5edec4 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:40.489460 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ae315ca6-e082-43af-b47e-98df3a5edec4 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:40.489460 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ae315ca6-e082-43af-b47e-98df3a5edec4 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:40.489460 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ae315ca6-e082-43af-b47e-98df3a5edec4 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:40.489870 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ae315ca6-e082-43af-b47e-98df3a5edec4 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:40.489870 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-ae315ca6-e082-43af-b47e-98df3a5edec4 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:40.520078 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-ae315ca6-e082-43af-b47e-98df3a5edec4 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049320 Aug 22 17:44:40.520971 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 584/1166] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:44:40 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:44:40.585940 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:44:40.590186 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-391febeb-a202-4af5-9d68-5251278f137f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:40.590720 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-391febeb-a202-4af5-9d68-5251278f137f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:40.596767 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-391febeb-a202-4af5-9d68-5251278f137f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:40.605311 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-391febeb-a202-4af5-9d68-5251278f137f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:40.605311 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-391febeb-a202-4af5-9d68-5251278f137f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:40.605311 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-391febeb-a202-4af5-9d68-5251278f137f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:40.605311 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-391febeb-a202-4af5-9d68-5251278f137f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:40.605909 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-391febeb-a202-4af5-9d68-5251278f137f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:40.631446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-391febeb-a202-4af5-9d68-5251278f137f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Going to try to terminate instance {{(pid=121852) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:44:40.918555 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-391febeb-a202-4af5-9d68-5251278f137f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 204 len: 0 microversion: 2.1 time: 0.334562 Aug 22 17:44:40.919198 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 583/1167] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:44:40 2022] DELETE /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:44:40.928014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-7970281e-a914-4043-b312-73d5aaae3a77 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:40.929437 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-7970281e-a914-4043-b312-73d5aaae3a77 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:40.936048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7970281e-a914-4043-b312-73d5aaae3a77 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:40.936539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7970281e-a914-4043-b312-73d5aaae3a77 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:40.936982 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7970281e-a914-4043-b312-73d5aaae3a77 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:40.937685 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7970281e-a914-4043-b312-73d5aaae3a77 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:40.938137 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7970281e-a914-4043-b312-73d5aaae3a77 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:40.938590 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-7970281e-a914-4043-b312-73d5aaae3a77 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:41.076463 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-7970281e-a914-4043-b312-73d5aaae3a77 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:44:41.084181 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-7970281e-a914-4043-b312-73d5aaae3a77 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1673 microversion: 2.1 time: 0.160386 Aug 22 17:44:41.084955 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 585/1168] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:44:40 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:44:42.105942 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8845cbc9-d1a7-4c10-88ee-b4fda5247390 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:42.107542 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8845cbc9-d1a7-4c10-88ee-b4fda5247390 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:42.114059 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8845cbc9-d1a7-4c10-88ee-b4fda5247390 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:42.114563 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8845cbc9-d1a7-4c10-88ee-b4fda5247390 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:42.114995 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8845cbc9-d1a7-4c10-88ee-b4fda5247390 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:42.115675 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8845cbc9-d1a7-4c10-88ee-b4fda5247390 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:42.116118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8845cbc9-d1a7-4c10-88ee-b4fda5247390 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:42.116534 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8845cbc9-d1a7-4c10-88ee-b4fda5247390 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:42.251597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8845cbc9-d1a7-4c10-88ee-b4fda5247390 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:44:42.259491 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8845cbc9-d1a7-4c10-88ee-b4fda5247390 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1673 microversion: 2.1 time: 0.157871 Aug 22 17:44:42.260066 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 584/1169] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:44:42 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:44:43.282197 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8f648b4c-fe9c-4c9b-9e68-c393fa612eeb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:43.282841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8f648b4c-fe9c-4c9b-9e68-c393fa612eeb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:43.289112 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8f648b4c-fe9c-4c9b-9e68-c393fa612eeb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:43.289685 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8f648b4c-fe9c-4c9b-9e68-c393fa612eeb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:43.290189 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8f648b4c-fe9c-4c9b-9e68-c393fa612eeb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:43.290990 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8f648b4c-fe9c-4c9b-9e68-c393fa612eeb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:43.291514 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8f648b4c-fe9c-4c9b-9e68-c393fa612eeb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:43.292002 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8f648b4c-fe9c-4c9b-9e68-c393fa612eeb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:43.518994 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8f648b4c-fe9c-4c9b-9e68-c393fa612eeb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:44:43.526783 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8f648b4c-fe9c-4c9b-9e68-c393fa612eeb tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1673 microversion: 2.1 time: 0.249226 Aug 22 17:44:43.527348 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 586/1170] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:44:43 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1673 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:44:44.227880 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-d4d0e235-4e69-4408-8b54-5424d32a5dd8 req-7177c90b-1532-461a-b4df-919596b7f8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3c3789f-b7a2-49c1-a3f1-74819ced4a46", "name": "network-vif-deleted", "tag": "c63e0529-5820-4836-a08f-6f39ef67edb8"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:44:44.241125 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-d4d0e235-4e69-4408-8b54-5424d32a5dd8 req-7177c90b-1532-461a-b4df-919596b7f8dd service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:44.241713 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-d4d0e235-4e69-4408-8b54-5424d32a5dd8 req-7177c90b-1532-461a-b4df-919596b7f8dd service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:44.242403 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-d4d0e235-4e69-4408-8b54-5424d32a5dd8 req-7177c90b-1532-461a-b4df-919596b7f8dd service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:44.258285 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-d4d0e235-4e69-4408-8b54-5424d32a5dd8 req-7177c90b-1532-461a-b4df-919596b7f8dd service nova] Creating event network-vif-deleted:c63e0529-5820-4836-a08f-6f39ef67edb8 for instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 on hv-cinder-85394 Aug 22 17:44:44.263885 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-d4d0e235-4e69-4408-8b54-5424d32a5dd8 req-7177c90b-1532-461a-b4df-919596b7f8dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.261004 Aug 22 17:44:44.265047 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 585/1171] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:44:44.556349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-be1a8d65-62b0-4cab-8994-910a3af9a58b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:44.556971 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-be1a8d65-62b0-4cab-8994-910a3af9a58b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:44.564416 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a8d65-62b0-4cab-8994-910a3af9a58b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:44.564936 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a8d65-62b0-4cab-8994-910a3af9a58b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:44.565372 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a8d65-62b0-4cab-8994-910a3af9a58b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:44.566119 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a8d65-62b0-4cab-8994-910a3af9a58b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:44.566598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a8d65-62b0-4cab-8994-910a3af9a58b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:44.567032 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a8d65-62b0-4cab-8994-910a3af9a58b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:44.602974 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a8d65-62b0-4cab-8994-910a3af9a58b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:44.603455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a8d65-62b0-4cab-8994-910a3af9a58b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:44.603888 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a8d65-62b0-4cab-8994-910a3af9a58b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:44.604364 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-be1a8d65-62b0-4cab-8994-910a3af9a58b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lazy-loading 'fault' on Instance uuid f3c3789f-b7a2-49c1-a3f1-74819ced4a46 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:44:44.661448 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-be1a8d65-62b0-4cab-8994-910a3af9a58b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:44:44.666746 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-be1a8d65-62b0-4cab-8994-910a3af9a58b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 200 len: 1327 microversion: 2.1 time: 0.121071 Aug 22 17:44:44.667325 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 587/1172] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:44:44 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 1327 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:44:45.693315 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0ff78434-c7be-4410-938f-07ef9b950f45 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:45.694001 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0ff78434-c7be-4410-938f-07ef9b950f45 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:45.700921 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0ff78434-c7be-4410-938f-07ef9b950f45 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:45.701296 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0ff78434-c7be-4410-938f-07ef9b950f45 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:45.701725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0ff78434-c7be-4410-938f-07ef9b950f45 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:45.702410 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0ff78434-c7be-4410-938f-07ef9b950f45 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:45.702880 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0ff78434-c7be-4410-938f-07ef9b950f45 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:45.703298 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0ff78434-c7be-4410-938f-07ef9b950f45 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:45.717597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-0ff78434-c7be-4410-938f-07ef9b950f45 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] HTTP exception thrown: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0ff78434-c7be-4410-938f-07ef9b950f45 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Request method failure captured: Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 HTTP/1.1 Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA79N1yB0hWF2s0WyuTCXI8TbyxxPxIb9yAx5PznEaY2qtT_YUf0jC-oDbFoVF9cZhNNYaLSOCiDuHp1epkJrBHBD5rOMSFIukzJHUSoWxF6M2-66EcD2IOANmPi3J0HZCxzI36wCnyOsj5Sjm-8X_e4kVqJf38Y1agQ79PjgXSqlL6Q Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 5f7d9ac076ce40b09043ced00f54f33a Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:44:45.719283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:44:45.721262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f7d9ac076ce40b09043ced00f54f33a", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:44:45.721262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:44:45.721262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 5f7d9ac076ce40b09043ced00f54f33a Aug 22 17:44:45.721262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:44:45.721262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeTestJSON-494350701-project Aug 22 17:44:45.721262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:44:45.721262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:44:45.721262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 5042520b122a4c6c94321a50ea57633a Aug 22 17:44:45.721262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeTestJSON-494350701-project Aug 22 17:44:45.721262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:44:45.721262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:44:45.721262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': 'f3c3789f-b7a2-49c1-a3f1-74819ced4a46'} Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:44:45.722278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:44:45.723951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:44:45.725435 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0ff78434-c7be-4410-938f-07ef9b950f45 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Returning 404 to user: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:44:45.725435 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0ff78434-c7be-4410-938f-07ef9b950f45 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 404 len: 111 microversion: 2.1 time: 0.032007 Aug 22 17:44:45.725435 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 586/1173] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:44:45 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:44:45.731404 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c869188b-b6b0-40ad-8a30-a16edd58701a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '.version_select at 0x7f0e5c7c7430>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:45.736211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c869188b-b6b0-40ad-8a30-a16edd58701a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [563e0e38-4c02-4c8e-9e3a-901ebc9e298e] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 22 17:44:46.744119 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO oslo.messaging._drivers.impl_rabbit [None req-c869188b-b6b0-40ad-8a30-a16edd58701a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [563e0e38-4c02-4c8e-9e3a-901ebc9e298e] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45020. Aug 22 17:44:46.849999 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c869188b-b6b0-40ad-8a30-a16edd58701a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110229342" status: 202 len: 0 microversion: 2.1 time: 1.122485 Aug 22 17:44:46.850609 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 588/1174] 10.222.0.20 () {58 vars in 1221 bytes} [Mon Aug 22 17:44:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1110229342 => generated 0 bytes in 1124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:44:47.925489 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9c1a1adb-de00-4a61-9806-a2aaa9d397f6 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Action: 'create', calling method: .version_select at 0x7f0e5d0c7430>, body: {"keypair": {"name": "tempest-keypair-683324891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGAQYUiUfJ88tBYFAV5lWGH/JEvlIJ3IzYOemzDnxKsTbv9gOr0AQQhO3H54H1a6amn6pzRpu7zLSIh5djpZRZ9Mjl41sY5tpUNyCwFx94gX8AoHVxHhvSRqqDjIaxNJLQ=="}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:44:47.941791 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-9c1a1adb-de00-4a61-9806-a2aaa9d397f6 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Getting quotas for project 5f7d9ac076ce40b09043ced00f54f33a. Resources: {'key_pairs'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:44:47.945830 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-9c1a1adb-de00-4a61-9806-a2aaa9d397f6 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Getting quotas for user 5042520b122a4c6c94321a50ea57633a and project 5f7d9ac076ce40b09043ced00f54f33a. Resources: {'key_pairs'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:44:48.038868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9c1a1adb-de00-4a61-9806-a2aaa9d397f6 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.117511 Aug 22 17:44:48.039503 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 587/1175] 10.222.0.20 () {60 vars in 1159 bytes} [Mon Aug 22 17:44:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:44:50.153760 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1643509818", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f2a3fa06-167f-4474-afdd-acf70dfabd5c"}], "security_groups": [{"name": "tempest-securitygroup--974431837"}], "key_name": "tempest-keypair-683324891", "user_data": "}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:44:50.264787 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.network.neutron [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] validate_networks() for [('f2a3fa06-167f-4474-afdd-acf70dfabd5c', None, None, None, None, None)] {{(pid=121853) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:44:50.768727 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Flavor limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:44:50.769205 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Image limits 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:44:50.769683 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Flavor pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:44:50.770189 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Image pref 0:0:0 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:44:50.770571 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.virt.hardware [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121853) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:44:50.780028 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:50.780506 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:50.780942 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:50.781674 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:50.782124 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:50.782583 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:50.800567 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Getting quotas for project 5f7d9ac076ce40b09043ced00f54f33a. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:44:50.804599 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.quota [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Getting quotas for user 5042520b122a4c6c94321a50ea57633a and project 5f7d9ac076ce40b09043ced00f54f33a. Resources: {'cores', 'instances', 'ram'} {{(pid=121853) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:44:50.815987 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Going to run 1 instances... {{(pid=121853) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:44:50.818300 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121853) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:44:51.007948 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-67879175-38dd-4ef2-b6ad-9bdaba7a0d1d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.858858 Aug 22 17:44:51.008613 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 589/1176] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:44:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:44:51.020228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-45cd76af-dec5-4380-af2d-53be34c2859b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:51.020784 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-45cd76af-dec5-4380-af2d-53be34c2859b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:51.077791 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-45cd76af-dec5-4380-af2d-53be34c2859b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:44:51.084742 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-45cd76af-dec5-4380-af2d-53be34c2859b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1237 microversion: 2.1 time: 0.068542 Aug 22 17:44:51.085305 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 588/1177] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:44:51 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:44:52.105295 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8de94e4a-0250-459f-a283-43675a587015 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:52.106645 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8de94e4a-0250-459f-a283-43675a587015 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:52.166563 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8de94e4a-0250-459f-a283-43675a587015 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:44:52.174236 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8de94e4a-0250-459f-a283-43675a587015 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1237 microversion: 2.1 time: 0.072721 Aug 22 17:44:52.174853 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 590/1178] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:44:52 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:44:53.196286 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c11e0987-8d88-4e6e-a817-a10ea998c73f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:53.196920 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c11e0987-8d88-4e6e-a817-a10ea998c73f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:53.257667 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-c11e0987-8d88-4e6e-a817-a10ea998c73f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:44:53.265669 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c11e0987-8d88-4e6e-a817-a10ea998c73f tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1237 microversion: 2.1 time: 0.073118 Aug 22 17:44:53.266244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 589/1179] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:44:53 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1237 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:44:54.287340 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4bfe88f4-0cdb-46c5-9c66-35cddbf9beee tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:54.288043 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4bfe88f4-0cdb-46c5-9c66-35cddbf9beee tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:54.343206 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4bfe88f4-0cdb-46c5-9c66-35cddbf9beee tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:44:54.350823 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4bfe88f4-0cdb-46c5-9c66-35cddbf9beee tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1237 microversion: 2.1 time: 0.067566 Aug 22 17:44:54.351426 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 591/1180] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:44:54 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:44:55.373585 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-34430a20-eb23-4670-b5f4-ab1eac75d510 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:55.374151 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-34430a20-eb23-4670-b5f4-ab1eac75d510 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:55.380506 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34430a20-eb23-4670-b5f4-ab1eac75d510 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:55.381021 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34430a20-eb23-4670-b5f4-ab1eac75d510 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:55.381453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34430a20-eb23-4670-b5f4-ab1eac75d510 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:55.382144 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34430a20-eb23-4670-b5f4-ab1eac75d510 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:55.382622 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34430a20-eb23-4670-b5f4-ab1eac75d510 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:55.383084 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34430a20-eb23-4670-b5f4-ab1eac75d510 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:55.444715 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-34430a20-eb23-4670-b5f4-ab1eac75d510 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:44:55.453452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-34430a20-eb23-4670-b5f4-ab1eac75d510 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1241 microversion: 2.1 time: 0.084456 Aug 22 17:44:55.454039 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 590/1181] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:44:55 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:44:56.474752 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-49fd1b5b-06d7-4f1c-bbe3-76bf0d83d940 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:56.475533 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-49fd1b5b-06d7-4f1c-bbe3-76bf0d83d940 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:56.484936 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-49fd1b5b-06d7-4f1c-bbe3-76bf0d83d940 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:56.488521 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-49fd1b5b-06d7-4f1c-bbe3-76bf0d83d940 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:56.488521 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-49fd1b5b-06d7-4f1c-bbe3-76bf0d83d940 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:56.488521 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-49fd1b5b-06d7-4f1c-bbe3-76bf0d83d940 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:56.488521 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-49fd1b5b-06d7-4f1c-bbe3-76bf0d83d940 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:56.488894 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-49fd1b5b-06d7-4f1c-bbe3-76bf0d83d940 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:56.553086 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-49fd1b5b-06d7-4f1c-bbe3-76bf0d83d940 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:44:56.562139 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-49fd1b5b-06d7-4f1c-bbe3-76bf0d83d940 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1289 microversion: 2.1 time: 0.091365 Aug 22 17:44:56.562749 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 592/1182] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:44:56 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:44:57.588374 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-f188b6fb-da32-460c-8566-a91e00d9bf53 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:57.589091 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-f188b6fb-da32-460c-8566-a91e00d9bf53 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:57.596388 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f188b6fb-da32-460c-8566-a91e00d9bf53 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:57.596887 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f188b6fb-da32-460c-8566-a91e00d9bf53 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:57.597331 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f188b6fb-da32-460c-8566-a91e00d9bf53 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:57.598038 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f188b6fb-da32-460c-8566-a91e00d9bf53 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:57.598522 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f188b6fb-da32-460c-8566-a91e00d9bf53 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:57.598956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-f188b6fb-da32-460c-8566-a91e00d9bf53 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:57.662303 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-f188b6fb-da32-460c-8566-a91e00d9bf53 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:44:57.670211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-f188b6fb-da32-460c-8566-a91e00d9bf53 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1295 microversion: 2.1 time: 0.085704 Aug 22 17:44:57.670905 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 591/1183] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:44:57 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1295 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:44:58.661096 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-68247564-1eb9-4752-affd-801e852c4164 req-df89c4c5-f0ab-4410-90f9-438b65b6ffa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83cdc06d-1f87-41c5-8cc9-7d778b378882", "tag": "1820fa97-9190-4e8d-a208-8339e8b40a72"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:44:58.672950 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-68247564-1eb9-4752-affd-801e852c4164 req-df89c4c5-f0ab-4410-90f9-438b65b6ffa8 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:58.673497 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-68247564-1eb9-4752-affd-801e852c4164 req-df89c4c5-f0ab-4410-90f9-438b65b6ffa8 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:58.673940 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-68247564-1eb9-4752-affd-801e852c4164 req-df89c4c5-f0ab-4410-90f9-438b65b6ffa8 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:58.686637 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-68247564-1eb9-4752-affd-801e852c4164 req-df89c4c5-f0ab-4410-90f9-438b65b6ffa8 service nova] Creating event network-changed:1820fa97-9190-4e8d-a208-8339e8b40a72 for instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 on hv-cinder-85394 Aug 22 17:44:58.692276 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-68247564-1eb9-4752-affd-801e852c4164 req-df89c4c5-f0ab-4410-90f9-438b65b6ffa8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035353 Aug 22 17:44:58.695875 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2220e0f1-2bad-4c33-9db1-976169c663e9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:58.695875 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-2220e0f1-2bad-4c33-9db1-976169c663e9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:58.696532 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 593/1184] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:44:58.699836 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2220e0f1-2bad-4c33-9db1-976169c663e9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:58.700343 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2220e0f1-2bad-4c33-9db1-976169c663e9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:58.700768 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2220e0f1-2bad-4c33-9db1-976169c663e9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:58.702555 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2220e0f1-2bad-4c33-9db1-976169c663e9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:58.703016 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2220e0f1-2bad-4c33-9db1-976169c663e9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:58.703647 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-2220e0f1-2bad-4c33-9db1-976169c663e9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:58.845013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-2220e0f1-2bad-4c33-9db1-976169c663e9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:44:58.851803 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2220e0f1-2bad-4c33-9db1-976169c663e9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1362 microversion: 2.1 time: 0.163721 Aug 22 17:44:58.852383 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 592/1185] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:44:58 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:44:59.873566 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2d359907-ec1d-4847-a7d9-e4dc785f6297 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:44:59.874255 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2d359907-ec1d-4847-a7d9-e4dc785f6297 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:44:59.880981 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d359907-ec1d-4847-a7d9-e4dc785f6297 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:59.881468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d359907-ec1d-4847-a7d9-e4dc785f6297 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:59.881946 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d359907-ec1d-4847-a7d9-e4dc785f6297 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:44:59.882671 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d359907-ec1d-4847-a7d9-e4dc785f6297 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:44:59.883123 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d359907-ec1d-4847-a7d9-e4dc785f6297 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:44:59.883549 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2d359907-ec1d-4847-a7d9-e4dc785f6297 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:00.021976 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2d359907-ec1d-4847-a7d9-e4dc785f6297 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:45:00.030406 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2d359907-ec1d-4847-a7d9-e4dc785f6297 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1362 microversion: 2.1 time: 0.160659 Aug 22 17:45:00.031012 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 594/1186] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:44:59 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:45:01.051643 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-911d1d0d-0c72-425f-9eaa-baa1394155e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:45:01.052254 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-911d1d0d-0c72-425f-9eaa-baa1394155e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:45:01.058965 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-911d1d0d-0c72-425f-9eaa-baa1394155e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:01.059452 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-911d1d0d-0c72-425f-9eaa-baa1394155e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:01.059894 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-911d1d0d-0c72-425f-9eaa-baa1394155e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:01.061382 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-911d1d0d-0c72-425f-9eaa-baa1394155e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:01.061958 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-911d1d0d-0c72-425f-9eaa-baa1394155e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:01.062391 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-911d1d0d-0c72-425f-9eaa-baa1394155e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:01.195561 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-911d1d0d-0c72-425f-9eaa-baa1394155e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:45:01.204122 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-911d1d0d-0c72-425f-9eaa-baa1394155e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1362 microversion: 2.1 time: 0.156189 Aug 22 17:45:01.204711 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 593/1187] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:45:01 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:45:02.224085 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e270b51e-c026-4f4e-bfc7-ed226159e95c tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:45:02.224679 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e270b51e-c026-4f4e-bfc7-ed226159e95c tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:45:02.226613 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:45:02.232331 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e270b51e-c026-4f4e-bfc7-ed226159e95c tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:02.236154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e270b51e-c026-4f4e-bfc7-ed226159e95c tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:02.236154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e270b51e-c026-4f4e-bfc7-ed226159e95c tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:02.236154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e270b51e-c026-4f4e-bfc7-ed226159e95c tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:02.236154 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e270b51e-c026-4f4e-bfc7-ed226159e95c tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:02.236714 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e270b51e-c026-4f4e-bfc7-ed226159e95c tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:02.366400 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e270b51e-c026-4f4e-bfc7-ed226159e95c tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:45:02.375046 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e270b51e-c026-4f4e-bfc7-ed226159e95c tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1362 microversion: 2.1 time: 0.154783 Aug 22 17:45:02.375612 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 595/1188] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:45:02 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:45:03.395641 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-df646e20-2587-48e0-9612-e666d0ff18bf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:45:03.396261 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-df646e20-2587-48e0-9612-e666d0ff18bf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:45:03.398757 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=8 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:45:03.404321 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df646e20-2587-48e0-9612-e666d0ff18bf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:03.404820 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df646e20-2587-48e0-9612-e666d0ff18bf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:03.405250 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df646e20-2587-48e0-9612-e666d0ff18bf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:03.406064 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df646e20-2587-48e0-9612-e666d0ff18bf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:03.406547 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df646e20-2587-48e0-9612-e666d0ff18bf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:03.406985 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df646e20-2587-48e0-9612-e666d0ff18bf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:03.545396 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-df646e20-2587-48e0-9612-e666d0ff18bf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:45:03.553622 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-df646e20-2587-48e0-9612-e666d0ff18bf tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1362 microversion: 2.1 time: 0.161790 Aug 22 17:45:03.554432 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 594/1189] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:45:03 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:45:04.575367 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-fc22d36a-53e6-4ac0-879c-8b5c7da6f5c0 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:45:04.576677 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-fc22d36a-53e6-4ac0-879c-8b5c7da6f5c0 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:45:04.579020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=10 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:45:04.583980 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc22d36a-53e6-4ac0-879c-8b5c7da6f5c0 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:04.584482 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc22d36a-53e6-4ac0-879c-8b5c7da6f5c0 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:04.584916 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc22d36a-53e6-4ac0-879c-8b5c7da6f5c0 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:04.585613 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc22d36a-53e6-4ac0-879c-8b5c7da6f5c0 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:04.586054 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc22d36a-53e6-4ac0-879c-8b5c7da6f5c0 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:04.586472 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-fc22d36a-53e6-4ac0-879c-8b5c7da6f5c0 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:04.729984 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-fc22d36a-53e6-4ac0-879c-8b5c7da6f5c0 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:45:04.739262 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-fc22d36a-53e6-4ac0-879c-8b5c7da6f5c0 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1362 microversion: 2.1 time: 0.167771 Aug 22 17:45:04.739838 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 596/1190] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:45:04 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:45:05.722696 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-26a0ae94-58a1-433f-b5e5-8d5064bd4e09 req-074bd988-500d-4dab-b020-27c328b50c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83cdc06d-1f87-41c5-8cc9-7d778b378882", "name": "network-vif-plugged", "status": "completed", "tag": "1820fa97-9190-4e8d-a208-8339e8b40a72"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:45:05.732873 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-26a0ae94-58a1-433f-b5e5-8d5064bd4e09 req-074bd988-500d-4dab-b020-27c328b50c45 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:05.733350 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-26a0ae94-58a1-433f-b5e5-8d5064bd4e09 req-074bd988-500d-4dab-b020-27c328b50c45 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:05.733777 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-26a0ae94-58a1-433f-b5e5-8d5064bd4e09 req-074bd988-500d-4dab-b020-27c328b50c45 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:05.746593 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-26a0ae94-58a1-433f-b5e5-8d5064bd4e09 req-074bd988-500d-4dab-b020-27c328b50c45 service nova] Creating event network-vif-plugged:1820fa97-9190-4e8d-a208-8339e8b40a72 for instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 on hv-cinder-85394 Aug 22 17:45:05.753759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-26a0ae94-58a1-433f-b5e5-8d5064bd4e09 req-074bd988-500d-4dab-b020-27c328b50c45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094144 Aug 22 17:45:05.762258 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 595/1191] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:45:05.762509 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2e5c15f2-1fd0-41bf-9696-a57d0dce392d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:45:05.762509 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2e5c15f2-1fd0-41bf-9696-a57d0dce392d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:45:05.778580 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e5c15f2-1fd0-41bf-9696-a57d0dce392d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:05.780080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e5c15f2-1fd0-41bf-9696-a57d0dce392d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:05.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e5c15f2-1fd0-41bf-9696-a57d0dce392d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:05.781165 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e5c15f2-1fd0-41bf-9696-a57d0dce392d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:05.781815 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e5c15f2-1fd0-41bf-9696-a57d0dce392d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:05.782239 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2e5c15f2-1fd0-41bf-9696-a57d0dce392d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:05.917198 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2e5c15f2-1fd0-41bf-9696-a57d0dce392d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:45:05.925309 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2e5c15f2-1fd0-41bf-9696-a57d0dce392d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1362 microversion: 2.1 time: 0.168406 Aug 22 17:45:05.925856 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 597/1192] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:45:05 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:45:06.946778 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-85698a95-0522-4a3f-a277-113b5d1f9b97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:45:06.947496 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-85698a95-0522-4a3f-a277-113b5d1f9b97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:45:06.954265 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-85698a95-0522-4a3f-a277-113b5d1f9b97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:06.954772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-85698a95-0522-4a3f-a277-113b5d1f9b97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:06.955202 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-85698a95-0522-4a3f-a277-113b5d1f9b97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:06.955888 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-85698a95-0522-4a3f-a277-113b5d1f9b97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:06.956334 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-85698a95-0522-4a3f-a277-113b5d1f9b97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:06.956751 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-85698a95-0522-4a3f-a277-113b5d1f9b97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:07.096768 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-85698a95-0522-4a3f-a277-113b5d1f9b97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:45:07.104714 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-85698a95-0522-4a3f-a277-113b5d1f9b97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1362 microversion: 2.1 time: 0.163005 Aug 22 17:45:07.105297 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 596/1193] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:45:06 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:45:08.126612 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-442b25ec-8b8c-4b54-acd0-01e4b8373679 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:45:08.127245 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-442b25ec-8b8c-4b54-acd0-01e4b8373679 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:45:08.133807 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-442b25ec-8b8c-4b54-acd0-01e4b8373679 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:08.134289 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-442b25ec-8b8c-4b54-acd0-01e4b8373679 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:08.134742 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-442b25ec-8b8c-4b54-acd0-01e4b8373679 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:08.135435 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-442b25ec-8b8c-4b54-acd0-01e4b8373679 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:08.135876 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-442b25ec-8b8c-4b54-acd0-01e4b8373679 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:08.136292 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-442b25ec-8b8c-4b54-acd0-01e4b8373679 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:08.274281 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-442b25ec-8b8c-4b54-acd0-01e4b8373679 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:45:08.282624 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-442b25ec-8b8c-4b54-acd0-01e4b8373679 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1549 microversion: 2.1 time: 0.160847 Aug 22 17:45:08.283204 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 598/1194] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:45:08 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:45:08.304209 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4d061aad-cad5-4320-88ca-f94e92600fb9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:45:08.304892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4d061aad-cad5-4320-88ca-f94e92600fb9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:45:08.312531 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4d061aad-cad5-4320-88ca-f94e92600fb9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:08.313013 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4d061aad-cad5-4320-88ca-f94e92600fb9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:08.313441 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4d061aad-cad5-4320-88ca-f94e92600fb9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:08.314148 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4d061aad-cad5-4320-88ca-f94e92600fb9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:08.314618 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4d061aad-cad5-4320-88ca-f94e92600fb9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:08.315038 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4d061aad-cad5-4320-88ca-f94e92600fb9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:08.393206 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4d061aad-cad5-4320-88ca-f94e92600fb9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092945 Aug 22 17:45:08.393790 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 597/1195] 10.222.0.20 () {58 vars in 1275 bytes} [Mon Aug 22 17:45:08 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:45:09.398365 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-ac35976b-9bd1-4d6e-be97-fa4f6787d9f6 req-aac37d23-d9ac-413d-8cea-0abe009d1af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83cdc06d-1f87-41c5-8cc9-7d778b378882", "tag": "1820fa97-9190-4e8d-a208-8339e8b40a72"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:45:09.408801 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-ac35976b-9bd1-4d6e-be97-fa4f6787d9f6 req-aac37d23-d9ac-413d-8cea-0abe009d1af4 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:45:09.409366 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-ac35976b-9bd1-4d6e-be97-fa4f6787d9f6 req-aac37d23-d9ac-413d-8cea-0abe009d1af4 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:45:09.409856 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-ac35976b-9bd1-4d6e-be97-fa4f6787d9f6 req-aac37d23-d9ac-413d-8cea-0abe009d1af4 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:45:09.421285 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-ac35976b-9bd1-4d6e-be97-fa4f6787d9f6 req-aac37d23-d9ac-413d-8cea-0abe009d1af4 service nova] Creating event network-changed:1820fa97-9190-4e8d-a208-8339e8b40a72 for instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 on hv-cinder-85394 Aug 22 17:45:09.426361 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-ac35976b-9bd1-4d6e-be97-fa4f6787d9f6 req-aac37d23-d9ac-413d-8cea-0abe009d1af4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031693 Aug 22 17:45:09.426991 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 599/1196] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:45:13.393430 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:45:13.394018 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Mon Aug 22 17:45:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:46:24.455672 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:46:24.461488 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:46:24.461488 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8c17980c-7896-4010-82c1-881e8a2f2361 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:24.461488 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8c17980c-7896-4010-82c1-881e8a2f2361 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:24.466956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c17980c-7896-4010-82c1-881e8a2f2361 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:24.467429 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c17980c-7896-4010-82c1-881e8a2f2361 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:24.467864 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c17980c-7896-4010-82c1-881e8a2f2361 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:24.468551 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c17980c-7896-4010-82c1-881e8a2f2361 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:24.469004 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c17980c-7896-4010-82c1-881e8a2f2361 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:24.469427 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8c17980c-7896-4010-82c1-881e8a2f2361 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:24.494182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8c17980c-7896-4010-82c1-881e8a2f2361 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/ips" status: 200 len: 146 microversion: 2.1 time: 0.040264 Aug 22 17:46:24.494705 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 598/1197] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 22 17:46:24 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:46:27.211811 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:46:27.212551 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=68 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:46:27.217780 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-018fa011-8fdd-4b0d-b33a-f5c4c149c37e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc1d061e-d0b0-4974-8a9e-a5e0b525f0eb"}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:46:27.223864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-018fa011-8fdd-4b0d-b33a-f5c4c149c37e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:27.226503 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-018fa011-8fdd-4b0d-b33a-f5c4c149c37e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:27.227020 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-018fa011-8fdd-4b0d-b33a-f5c4c149c37e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:27.227463 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-018fa011-8fdd-4b0d-b33a-f5c4c149c37e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:27.228162 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-018fa011-8fdd-4b0d-b33a-f5c4c149c37e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:27.228617 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-018fa011-8fdd-4b0d-b33a-f5c4c149c37e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:27.229042 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-018fa011-8fdd-4b0d-b33a-f5c4c149c37e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:27.942042 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-018fa011-8fdd-4b0d-b33a-f5c4c149c37e tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "POST /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.731989 Aug 22 17:46:27.942776 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 600/1198] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 22 17:46:27 2022] POST /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments => generated 194 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:46:35.491199 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-84ceec26-5fd5-4d57-bacc-b7bcef1bb727 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:35.494188 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-84ceec26-5fd5-4d57-bacc-b7bcef1bb727 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:35.503184 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-84ceec26-5fd5-4d57-bacc-b7bcef1bb727 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:35.503772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-84ceec26-5fd5-4d57-bacc-b7bcef1bb727 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:35.504271 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-84ceec26-5fd5-4d57-bacc-b7bcef1bb727 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:35.504984 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-84ceec26-5fd5-4d57-bacc-b7bcef1bb727 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:35.505442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-84ceec26-5fd5-4d57-bacc-b7bcef1bb727 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:35.505865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-84ceec26-5fd5-4d57-bacc-b7bcef1bb727 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:35.538423 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-84ceec26-5fd5-4d57-bacc-b7bcef1bb727 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052049 Aug 22 17:46:35.539468 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 599/1199] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:46:35 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:46:35.553608 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-af817998-9bc5-4d91-b863-b5966deee3ec tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:35.554186 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-af817998-9bc5-4d91-b863-b5966deee3ec tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:35.560363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-af817998-9bc5-4d91-b863-b5966deee3ec tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:35.560841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-af817998-9bc5-4d91-b863-b5966deee3ec tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:35.561273 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-af817998-9bc5-4d91-b863-b5966deee3ec tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:35.561961 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-af817998-9bc5-4d91-b863-b5966deee3ec tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:35.562572 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-af817998-9bc5-4d91-b863-b5966deee3ec tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:35.563013 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-af817998-9bc5-4d91-b863-b5966deee3ec tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:35.595026 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-af817998-9bc5-4d91-b863-b5966deee3ec tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments/dc1d061e-d0b0-4974-8a9e-a5e0b525f0eb" status: 200 len: 194 microversion: 2.1 time: 0.047569 Aug 22 17:46:35.595622 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 601/1200] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Aug 22 17:46:35 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments/dc1d061e-d0b0-4974-8a9e-a5e0b525f0eb => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:46:37.272621 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-bbad1e97-d336-4273-a286-470d0512a109 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1103e1d7-4cbb-46d3-8cda-d988a5fe4f7a"}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:46:37.275149 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-bbad1e97-d336-4273-a286-470d0512a109 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:37.284520 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bbad1e97-d336-4273-a286-470d0512a109 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:37.285135 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bbad1e97-d336-4273-a286-470d0512a109 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:37.285684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bbad1e97-d336-4273-a286-470d0512a109 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:37.286419 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bbad1e97-d336-4273-a286-470d0512a109 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:37.286934 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bbad1e97-d336-4273-a286-470d0512a109 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:37.287472 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bbad1e97-d336-4273-a286-470d0512a109 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:38.198219 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-bbad1e97-d336-4273-a286-470d0512a109 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "POST /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.931188 Aug 22 17:46:38.198914 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 600/1201] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 22 17:46:37 2022] POST /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments => generated 194 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:46:45.797757 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c8517981-e23c-447e-a038-e86c593e0406 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:45.800656 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-c8517981-e23c-447e-a038-e86c593e0406 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:45.803823 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=4 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:46:45.804612 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:46:45.811635 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c8517981-e23c-447e-a038-e86c593e0406 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:45.812779 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c8517981-e23c-447e-a038-e86c593e0406 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:45.813212 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c8517981-e23c-447e-a038-e86c593e0406 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:45.814103 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c8517981-e23c-447e-a038-e86c593e0406 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:45.814577 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c8517981-e23c-447e-a038-e86c593e0406 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:45.814997 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-c8517981-e23c-447e-a038-e86c593e0406 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:45.847840 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c8517981-e23c-447e-a038-e86c593e0406 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.053351 Aug 22 17:46:45.848621 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 602/1202] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:46:45 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments => generated 371 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:46:46.004861 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3502e280-f0e4-40cc-a8d7-08499d10c7e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:46.005444 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3502e280-f0e4-40cc-a8d7-08499d10c7e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:46.012158 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3502e280-f0e4-40cc-a8d7-08499d10c7e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:46.012649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3502e280-f0e4-40cc-a8d7-08499d10c7e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:46.013081 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3502e280-f0e4-40cc-a8d7-08499d10c7e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:46.013811 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3502e280-f0e4-40cc-a8d7-08499d10c7e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:46.014296 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3502e280-f0e4-40cc-a8d7-08499d10c7e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:46.014751 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3502e280-f0e4-40cc-a8d7-08499d10c7e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:46.044314 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3502e280-f0e4-40cc-a8d7-08499d10c7e3 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments/dc1d061e-d0b0-4974-8a9e-a5e0b525f0eb" status: 200 len: 194 microversion: 2.1 time: 0.044756 Aug 22 17:46:46.044910 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 601/1203] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Aug 22 17:46:45 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments/dc1d061e-d0b0-4974-8a9e-a5e0b525f0eb => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:46:46.055780 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e8e40384-a742-4fac-a030-df449d949d40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:46.056273 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e8e40384-a742-4fac-a030-df449d949d40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:46.063660 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e8e40384-a742-4fac-a030-df449d949d40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:46.064149 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e8e40384-a742-4fac-a030-df449d949d40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:46.064588 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e8e40384-a742-4fac-a030-df449d949d40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:46.065277 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e8e40384-a742-4fac-a030-df449d949d40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:46.066335 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e8e40384-a742-4fac-a030-df449d949d40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:46.066797 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e8e40384-a742-4fac-a030-df449d949d40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:46.204042 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-e8e40384-a742-4fac-a030-df449d949d40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lazy-loading 'services' on Instance uuid 83cdc06d-1f87-41c5-8cc9-7d778b378882 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:46:46.428288 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e8e40384-a742-4fac-a030-df449d949d40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "DELETE /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments/dc1d061e-d0b0-4974-8a9e-a5e0b525f0eb" status: 202 len: 0 microversion: 2.1 time: 0.376408 Aug 22 17:46:46.428879 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 603/1204] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 22 17:46:46 2022] DELETE /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments/dc1d061e-d0b0-4974-8a9e-a5e0b525f0eb => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:46:48.617058 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-aa998fb0-2d0f-42c0-a83e-952d8ea19683 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:48.617659 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-aa998fb0-2d0f-42c0-a83e-952d8ea19683 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:48.624659 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aa998fb0-2d0f-42c0-a83e-952d8ea19683 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:48.625211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aa998fb0-2d0f-42c0-a83e-952d8ea19683 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:48.625651 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aa998fb0-2d0f-42c0-a83e-952d8ea19683 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:48.626355 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aa998fb0-2d0f-42c0-a83e-952d8ea19683 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:48.626865 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aa998fb0-2d0f-42c0-a83e-952d8ea19683 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:48.627292 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-aa998fb0-2d0f-42c0-a83e-952d8ea19683 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:48.659005 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-aa998fb0-2d0f-42c0-a83e-952d8ea19683 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments/1103e1d7-4cbb-46d3-8cda-d988a5fe4f7a" status: 200 len: 194 microversion: 2.1 time: 0.046178 Aug 22 17:46:48.659652 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 602/1205] 10.222.0.20 () {58 vars in 1413 bytes} [Mon Aug 22 17:46:48 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments/1103e1d7-4cbb-46d3-8cda-d988a5fe4f7a => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:46:48.671308 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e59a77ed-3735-4bbf-b3e9-bb01c5d3e474 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:48.671889 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e59a77ed-3735-4bbf-b3e9-bb01c5d3e474 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:48.678319 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e59a77ed-3735-4bbf-b3e9-bb01c5d3e474 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:48.678927 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e59a77ed-3735-4bbf-b3e9-bb01c5d3e474 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:48.679362 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e59a77ed-3735-4bbf-b3e9-bb01c5d3e474 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:48.680080 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e59a77ed-3735-4bbf-b3e9-bb01c5d3e474 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:48.680533 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e59a77ed-3735-4bbf-b3e9-bb01c5d3e474 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:48.680959 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e59a77ed-3735-4bbf-b3e9-bb01c5d3e474 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:48.766908 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-e59a77ed-3735-4bbf-b3e9-bb01c5d3e474 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lazy-loading 'services' on Instance uuid 83cdc06d-1f87-41c5-8cc9-7d778b378882 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:46:49.051242 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e59a77ed-3735-4bbf-b3e9-bb01c5d3e474 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "DELETE /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments/1103e1d7-4cbb-46d3-8cda-d988a5fe4f7a" status: 202 len: 0 microversion: 2.1 time: 0.384536 Aug 22 17:46:49.051832 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 604/1206] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 22 17:46:48 2022] DELETE /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments/1103e1d7-4cbb-46d3-8cda-d988a5fe4f7a => generated 0 bytes in 386 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:46:50.242798 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9a38545b-9b09-419a-b2b9-2c7ca62178f9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:50.245206 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9a38545b-9b09-419a-b2b9-2c7ca62178f9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:50.255100 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9a38545b-9b09-419a-b2b9-2c7ca62178f9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:50.255597 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9a38545b-9b09-419a-b2b9-2c7ca62178f9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:50.256071 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9a38545b-9b09-419a-b2b9-2c7ca62178f9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:50.256823 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9a38545b-9b09-419a-b2b9-2c7ca62178f9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:50.257280 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9a38545b-9b09-419a-b2b9-2c7ca62178f9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:50.257736 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9a38545b-9b09-419a-b2b9-2c7ca62178f9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:50.289804 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9a38545b-9b09-419a-b2b9-2c7ca62178f9 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052305 Aug 22 17:46:50.290376 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 603/1207] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:46:50 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:46:50.411292 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-5558a658-b0cc-44cd-afad-0060b85e683b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:50.413555 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-5558a658-b0cc-44cd-afad-0060b85e683b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:50.420203 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5558a658-b0cc-44cd-afad-0060b85e683b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:50.420618 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5558a658-b0cc-44cd-afad-0060b85e683b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:50.421048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5558a658-b0cc-44cd-afad-0060b85e683b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:50.421725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5558a658-b0cc-44cd-afad-0060b85e683b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:50.422166 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5558a658-b0cc-44cd-afad-0060b85e683b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:50.422725 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-5558a658-b0cc-44cd-afad-0060b85e683b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:50.454155 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-5558a658-b0cc-44cd-afad-0060b85e683b tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047862 Aug 22 17:46:50.454733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 605/1208] 10.222.0.20 () {58 vars in 1302 bytes} [Mon Aug 22 17:46:50 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 22 17:46:50.517394 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-be591d93-5b0d-40c1-951f-c1bfac0a6211 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:50.517895 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-be591d93-5b0d-40c1-951f-c1bfac0a6211 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:50.524483 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-be591d93-5b0d-40c1-951f-c1bfac0a6211 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:50.524978 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-be591d93-5b0d-40c1-951f-c1bfac0a6211 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:50.525418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-be591d93-5b0d-40c1-951f-c1bfac0a6211 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:50.526114 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-be591d93-5b0d-40c1-951f-c1bfac0a6211 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:50.526616 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-be591d93-5b0d-40c1-951f-c1bfac0a6211 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:50.527043 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-be591d93-5b0d-40c1-951f-c1bfac0a6211 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:50.555231 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-be591d93-5b0d-40c1-951f-c1bfac0a6211 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Going to try to terminate instance {{(pid=121852) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:46:50.926463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-be591d93-5b0d-40c1-951f-c1bfac0a6211 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "DELETE /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 204 len: 0 microversion: 2.1 time: 0.412515 Aug 22 17:46:50.927324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 604/1209] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:46:50 2022] DELETE /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:46:50.935762 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-274f50cd-7ae9-46bc-ad53-ccebd7bd2d97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:50.942748 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-274f50cd-7ae9-46bc-ad53-ccebd7bd2d97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:50.945352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-274f50cd-7ae9-46bc-ad53-ccebd7bd2d97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:50.945939 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-274f50cd-7ae9-46bc-ad53-ccebd7bd2d97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:50.946378 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-274f50cd-7ae9-46bc-ad53-ccebd7bd2d97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:50.947123 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-274f50cd-7ae9-46bc-ad53-ccebd7bd2d97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:50.947578 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-274f50cd-7ae9-46bc-ad53-ccebd7bd2d97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:50.948001 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-274f50cd-7ae9-46bc-ad53-ccebd7bd2d97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:51.091014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-274f50cd-7ae9-46bc-ad53-ccebd7bd2d97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:46:51.102616 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-274f50cd-7ae9-46bc-ad53-ccebd7bd2d97 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1673 microversion: 2.1 time: 0.170765 Aug 22 17:46:51.103221 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 606/1210] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:46:50 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:46:52.126703 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8af9e0c2-3c0a-4b1d-bed6-6b96dfe5b180 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:52.127337 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-8af9e0c2-3c0a-4b1d-bed6-6b96dfe5b180 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:52.133882 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8af9e0c2-3c0a-4b1d-bed6-6b96dfe5b180 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:52.134392 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8af9e0c2-3c0a-4b1d-bed6-6b96dfe5b180 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:52.134868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8af9e0c2-3c0a-4b1d-bed6-6b96dfe5b180 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:52.135568 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8af9e0c2-3c0a-4b1d-bed6-6b96dfe5b180 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:52.136025 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8af9e0c2-3c0a-4b1d-bed6-6b96dfe5b180 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:52.136453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-8af9e0c2-3c0a-4b1d-bed6-6b96dfe5b180 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:52.331079 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-8af9e0c2-3c0a-4b1d-bed6-6b96dfe5b180 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:46:52.339645 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8af9e0c2-3c0a-4b1d-bed6-6b96dfe5b180 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1673 microversion: 2.1 time: 0.217290 Aug 22 17:46:52.340219 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 605/1211] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:46:52 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1673 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:46:53.361573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-8de644df-da0e-4558-a777-63d4daf15c17 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:53.362214 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-8de644df-da0e-4558-a777-63d4daf15c17 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:53.369150 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8de644df-da0e-4558-a777-63d4daf15c17 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:53.369649 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8de644df-da0e-4558-a777-63d4daf15c17 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:53.370052 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8de644df-da0e-4558-a777-63d4daf15c17 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:53.370774 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8de644df-da0e-4558-a777-63d4daf15c17 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:53.371220 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8de644df-da0e-4558-a777-63d4daf15c17 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:53.371640 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-8de644df-da0e-4558-a777-63d4daf15c17 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:53.600209 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-8de644df-da0e-4558-a777-63d4daf15c17 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:46:53.607859 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-8de644df-da0e-4558-a777-63d4daf15c17 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1673 microversion: 2.1 time: 0.250137 Aug 22 17:46:53.608424 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 607/1212] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:46:53 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1673 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:46:54.089153 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-facec564-0b4a-4292-9418-aabb5da65241 req-7cc680e8-c56b-4148-9f56-9b3395da55cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83cdc06d-1f87-41c5-8cc9-7d778b378882", "name": "network-vif-deleted", "tag": "1820fa97-9190-4e8d-a208-8339e8b40a72"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:46:54.099706 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-facec564-0b4a-4292-9418-aabb5da65241 req-7cc680e8-c56b-4148-9f56-9b3395da55cc service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:54.100358 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-facec564-0b4a-4292-9418-aabb5da65241 req-7cc680e8-c56b-4148-9f56-9b3395da55cc service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:54.100788 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-facec564-0b4a-4292-9418-aabb5da65241 req-7cc680e8-c56b-4148-9f56-9b3395da55cc service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:54.111968 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-facec564-0b4a-4292-9418-aabb5da65241 req-7cc680e8-c56b-4148-9f56-9b3395da55cc service nova] Creating event network-vif-deleted:1820fa97-9190-4e8d-a208-8339e8b40a72 for instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 on hv-cinder-85394 Aug 22 17:46:54.118973 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-facec564-0b4a-4292-9418-aabb5da65241 req-7cc680e8-c56b-4148-9f56-9b3395da55cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035028 Aug 22 17:46:54.136683 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 606/1213] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:46:54.630014 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-603eaab3-ce4b-40f4-928d-cf2c3ba70e4d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:54.630696 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-603eaab3-ce4b-40f4-928d-cf2c3ba70e4d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:54.637152 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-603eaab3-ce4b-40f4-928d-cf2c3ba70e4d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:54.637639 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-603eaab3-ce4b-40f4-928d-cf2c3ba70e4d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:54.638072 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-603eaab3-ce4b-40f4-928d-cf2c3ba70e4d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:54.638830 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-603eaab3-ce4b-40f4-928d-cf2c3ba70e4d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:54.639278 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-603eaab3-ce4b-40f4-928d-cf2c3ba70e4d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:54.639733 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-603eaab3-ce4b-40f4-928d-cf2c3ba70e4d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:54.673126 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-603eaab3-ce4b-40f4-928d-cf2c3ba70e4d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:54.673604 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-603eaab3-ce4b-40f4-928d-cf2c3ba70e4d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:54.674156 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-603eaab3-ce4b-40f4-928d-cf2c3ba70e4d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:54.674781 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-603eaab3-ce4b-40f4-928d-cf2c3ba70e4d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lazy-loading 'fault' on Instance uuid 83cdc06d-1f87-41c5-8cc9-7d778b378882 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:46:54.717455 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-603eaab3-ce4b-40f4-928d-cf2c3ba70e4d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5042520b122a4c6c94321a50ea57633a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f7d9ac076ce40b09043ced00f54f33a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:46:54.726155 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-603eaab3-ce4b-40f4-928d-cf2c3ba70e4d tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 200 len: 1327 microversion: 2.1 time: 0.100405 Aug 22 17:46:54.726763 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 608/1214] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:46:54 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 1327 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:46:55.749195 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-14c15ba7-1f87-4ee2-a362-45ae93beb031 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:55.749910 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-14c15ba7-1f87-4ee2-a362-45ae93beb031 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:55.757245 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-14c15ba7-1f87-4ee2-a362-45ae93beb031 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:55.757733 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-14c15ba7-1f87-4ee2-a362-45ae93beb031 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:55.758170 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-14c15ba7-1f87-4ee2-a362-45ae93beb031 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:55.758892 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-14c15ba7-1f87-4ee2-a362-45ae93beb031 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:55.759347 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-14c15ba7-1f87-4ee2-a362-45ae93beb031 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:55.759817 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-14c15ba7-1f87-4ee2-a362-45ae93beb031 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:55.773953 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-14c15ba7-1f87-4ee2-a362-45ae93beb031 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] HTTP exception thrown: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-14c15ba7-1f87-4ee2-a362-45ae93beb031 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Request method failure captured: Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 HTTP/1.1 Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA79N1yB0hWF2s0WyuTCXI8TbyxxPxIb9yAx5PznEaY2qtT_YUf0jC-oDbFoVF9cZhNNYaLSOCiDuHp1epkJrBHBD5rOMSFIukzJHUSoWxF6M2-66EcD2IOANmPi3J0HZCxzI36wCnyOsj5Sjm-8X_e4kVqJf38Y1agQ79PjgXSqlL6Q Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 5f7d9ac076ce40b09043ced00f54f33a Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:46:55.775745 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:46:55.777606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f7d9ac076ce40b09043ced00f54f33a", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:46:55.777606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:46:55.777606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 5f7d9ac076ce40b09043ced00f54f33a Aug 22 17:46:55.777606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:46:55.777606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeTestJSON-494350701-project Aug 22 17:46:55.777606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:46:55.777606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:46:55.777606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 5042520b122a4c6c94321a50ea57633a Aug 22 17:46:55.777606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeTestJSON-494350701-project Aug 22 17:46:55.777606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:46:55.777606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:55.777606 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '83cdc06d-1f87-41c5-8cc9-7d778b378882'} Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:46:55.778725 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:55.780463 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:46:55.782070 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-14c15ba7-1f87-4ee2-a362-45ae93beb031 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Returning 404 to user: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:46:55.782070 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-14c15ba7-1f87-4ee2-a362-45ae93beb031 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 404 len: 111 microversion: 2.1 time: 0.032737 Aug 22 17:46:55.782070 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 607/1215] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:46:55 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:46:55.786319 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b70a3dfe-5116-4fc6-b415-a231e67e2175 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '.version_select at 0x7f0e5e45ba60>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:55.869821 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b70a3dfe-5116-4fc6-b415-a231e67e2175 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-683324891" status: 202 len: 0 microversion: 2.1 time: 0.087423 Aug 22 17:46:55.870393 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 609/1216] 10.222.0.20 () {58 vars in 1218 bytes} [Mon Aug 22 17:46:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-683324891 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:46:59.411918 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-92f2757b-8d6e-4886-9970-1b498484353a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:59.412545 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-92f2757b-8d6e-4886-9970-1b498484353a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:59.419268 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-92f2757b-8d6e-4886-9970-1b498484353a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:59.420735 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-92f2757b-8d6e-4886-9970-1b498484353a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:59.420735 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-92f2757b-8d6e-4886-9970-1b498484353a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:59.420972 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-92f2757b-8d6e-4886-9970-1b498484353a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:59.421297 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-92f2757b-8d6e-4886-9970-1b498484353a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:59.421843 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-92f2757b-8d6e-4886-9970-1b498484353a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:59.436824 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-92f2757b-8d6e-4886-9970-1b498484353a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] HTTP exception thrown: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-92f2757b-8d6e-4886-9970-1b498484353a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Request method failure captured: Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: DELETE /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 HTTP/1.1 Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA79N1yB0hWF2s0WyuTCXI8TbyxxPxIb9yAx5PznEaY2qtT_YUf0jC-oDbFoVF9cZhNNYaLSOCiDuHp1epkJrBHBD5rOMSFIukzJHUSoWxF6M2-66EcD2IOANmPi3J0HZCxzI36wCnyOsj5Sjm-8X_e4kVqJf38Y1agQ79PjgXSqlL6Q Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 5f7d9ac076ce40b09043ced00f54f33a Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:46:59.438406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:46:59.440211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f7d9ac076ce40b09043ced00f54f33a", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:46:59.440211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:46:59.440211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 5f7d9ac076ce40b09043ced00f54f33a Aug 22 17:46:59.440211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:46:59.440211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeTestJSON-494350701-project Aug 22 17:46:59.440211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:46:59.440211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:46:59.440211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 5042520b122a4c6c94321a50ea57633a Aug 22 17:46:59.440211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeTestJSON-494350701-project Aug 22 17:46:59.440211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:46:59.440211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:59.440211 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '83cdc06d-1f87-41c5-8cc9-7d778b378882'} Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:46:59.442786 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:59.444469 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:46:59.446241 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-92f2757b-8d6e-4886-9970-1b498484353a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Returning 404 to user: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:46:59.446241 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-92f2757b-8d6e-4886-9970-1b498484353a tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "DELETE /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 404 len: 111 microversion: 2.1 time: 0.032033 Aug 22 17:46:59.446241 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 608/1217] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:46:59 2022] DELETE /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:46:59.449741 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4776e4ee-c803-4bf8-9ea7-aff39111df40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:46:59.450463 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4776e4ee-c803-4bf8-9ea7-aff39111df40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: 83cdc06d-1f87-41c5-8cc9-7d778b378882] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:46:59.462934 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4776e4ee-c803-4bf8-9ea7-aff39111df40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:59.462934 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4776e4ee-c803-4bf8-9ea7-aff39111df40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:59.462934 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4776e4ee-c803-4bf8-9ea7-aff39111df40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:59.462934 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4776e4ee-c803-4bf8-9ea7-aff39111df40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:46:59.463468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4776e4ee-c803-4bf8-9ea7-aff39111df40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:46:59.463468 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-4776e4ee-c803-4bf8-9ea7-aff39111df40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:46:59.474005 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-4776e4ee-c803-4bf8-9ea7-aff39111df40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] HTTP exception thrown: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4776e4ee-c803-4bf8-9ea7-aff39111df40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Request method failure captured: Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 HTTP/1.1 Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA79N1yB0hWF2s0WyuTCXI8TbyxxPxIb9yAx5PznEaY2qtT_YUf0jC-oDbFoVF9cZhNNYaLSOCiDuHp1epkJrBHBD5rOMSFIukzJHUSoWxF6M2-66EcD2IOANmPi3J0HZCxzI36wCnyOsj5Sjm-8X_e4kVqJf38Y1agQ79PjgXSqlL6Q Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 5f7d9ac076ce40b09043ced00f54f33a Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:46:59.475708 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:46:59.477501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f7d9ac076ce40b09043ced00f54f33a", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:46:59.477501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:46:59.477501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 5f7d9ac076ce40b09043ced00f54f33a Aug 22 17:46:59.477501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:46:59.477501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-AttachVolumeTestJSON-494350701-project Aug 22 17:46:59.477501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:46:59.477501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:46:59.477501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: 5042520b122a4c6c94321a50ea57633a Aug 22 17:46:59.477501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-AttachVolumeTestJSON-494350701-project Aug 22 17:46:59.477501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:46:59.477501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:59.477501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': '83cdc06d-1f87-41c5-8cc9-7d778b378882'} Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:46:59.478562 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. Aug 22 17:46:59.485306 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:46:59.486864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4776e4ee-c803-4bf8-9ea7-aff39111df40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Returning 404 to user: Instance 83cdc06d-1f87-41c5-8cc9-7d778b378882 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:46:59.486864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4776e4ee-c803-4bf8-9ea7-aff39111df40 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882" status: 404 len: 111 microversion: 2.1 time: 0.031781 Aug 22 17:46:59.486864 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 610/1218] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:46:59 2022] GET /compute/v2.1/servers/83cdc06d-1f87-41c5-8cc9-7d778b378882 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:47:00.744233 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-08389261-1aa2-4e7b-96cd-16a54b5599fa tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:00.744839 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-08389261-1aa2-4e7b-96cd-16a54b5599fa tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:00.751359 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-08389261-1aa2-4e7b-96cd-16a54b5599fa tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:00.751834 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-08389261-1aa2-4e7b-96cd-16a54b5599fa tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:00.752262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-08389261-1aa2-4e7b-96cd-16a54b5599fa tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:00.753688 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-08389261-1aa2-4e7b-96cd-16a54b5599fa tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:00.754442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-08389261-1aa2-4e7b-96cd-16a54b5599fa tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:00.754894 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-08389261-1aa2-4e7b-96cd-16a54b5599fa tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:00.769228 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-08389261-1aa2-4e7b-96cd-16a54b5599fa tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] HTTP exception thrown: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-08389261-1aa2-4e7b-96cd-16a54b5599fa tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Request method failure captured: Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: DELETE /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 HTTP/1.1 Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA79N1yB0hWF2s0WyuTCXI8TbyxxPxIb9yAx5PznEaY2qtT_YUf0jC-oDbFoVF9cZhNNYaLSOCiDuHp1epkJrBHBD5rOMSFIukzJHUSoWxF6M2-66EcD2IOANmPi3J0HZCxzI36wCnyOsj5Sjm-8X_e4kVqJf38Y1agQ79PjgXSqlL6Q Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 5f7d9ac076ce40b09043ced00f54f33a Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:47:00.771223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:47:00.772956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f7d9ac076ce40b09043ced00f54f33a", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:47:00.772956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:47:00.772956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 5f7d9ac076ce40b09043ced00f54f33a Aug 22 17:47:00.772956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:47:00.772956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-AttachVolumeTestJSON-494350701-project Aug 22 17:47:00.772956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:47:00.772956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:47:00.772956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 5042520b122a4c6c94321a50ea57633a Aug 22 17:47:00.772956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-AttachVolumeTestJSON-494350701-project Aug 22 17:47:00.772956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:47:00.772956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:47:00.772956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': 'f3c3789f-b7a2-49c1-a3f1-74819ced4a46'} Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:47:00.774118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:47:00.775815 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:00.777417 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-08389261-1aa2-4e7b-96cd-16a54b5599fa tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Returning 404 to user: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:47:00.777417 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-08389261-1aa2-4e7b-96cd-16a54b5599fa tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 404 len: 111 microversion: 2.1 time: 0.032297 Aug 22 17:47:00.777417 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 609/1219] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:47:00 2022] DELETE /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:47:00.781303 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-081eafb5-f58e-4bf9-ace0-86f3c7ca4bb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:00.781922 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-081eafb5-f58e-4bf9-ace0-86f3c7ca4bb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] [instance: f3c3789f-b7a2-49c1-a3f1-74819ced4a46] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:00.789914 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-081eafb5-f58e-4bf9-ace0-86f3c7ca4bb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:00.790393 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-081eafb5-f58e-4bf9-ace0-86f3c7ca4bb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:00.790854 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-081eafb5-f58e-4bf9-ace0-86f3c7ca4bb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:00.791547 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-081eafb5-f58e-4bf9-ace0-86f3c7ca4bb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:00.791983 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-081eafb5-f58e-4bf9-ace0-86f3c7ca4bb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:00.792398 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-081eafb5-f58e-4bf9-ace0-86f3c7ca4bb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:00.807274 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-081eafb5-f58e-4bf9-ace0-86f3c7ca4bb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] HTTP exception thrown: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-081eafb5-f58e-4bf9-ace0-86f3c7ca4bb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Request method failure captured: Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 HTTP/1.1 Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA79N1yB0hWF2s0WyuTCXI8TbyxxPxIb9yAx5PznEaY2qtT_YUf0jC-oDbFoVF9cZhNNYaLSOCiDuHp1epkJrBHBD5rOMSFIukzJHUSoWxF6M2-66EcD2IOANmPi3J0HZCxzI36wCnyOsj5Sjm-8X_e4kVqJf38Y1agQ79PjgXSqlL6Q Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 5f7d9ac076ce40b09043ced00f54f33a Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:47:00.808802 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:47:00.810592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5f7d9ac076ce40b09043ced00f54f33a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5f7d9ac076ce40b09043ced00f54f33a", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:47:00.810592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:47:00.810592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 5f7d9ac076ce40b09043ced00f54f33a Aug 22 17:47:00.810592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-AttachVolumeTestJSON-494350701 Aug 22 17:47:00.810592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-AttachVolumeTestJSON-494350701-project Aug 22 17:47:00.810592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:47:00.810592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:47:00.810592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: 5042520b122a4c6c94321a50ea57633a Aug 22 17:47:00.810592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-AttachVolumeTestJSON-494350701-project Aug 22 17:47:00.810592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:47:00.810592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:47:00.810592 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': 'f3c3789f-b7a2-49c1-a3f1-74819ced4a46'} Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:47:00.811728 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. Aug 22 17:47:00.813349 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:00.814811 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-081eafb5-f58e-4bf9-ace0-86f3c7ca4bb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] Returning 404 to user: Instance f3c3789f-b7a2-49c1-a3f1-74819ced4a46 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:47:00.814811 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-081eafb5-f58e-4bf9-ace0-86f3c7ca4bb1 tempest-AttachVolumeTestJSON-494350701 tempest-AttachVolumeTestJSON-494350701-project] 10.222.0.20 "GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46" status: 404 len: 111 microversion: 2.1 time: 0.032778 Aug 22 17:47:00.814811 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 611/1220] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:00 2022] GET /compute/v2.1/servers/f3c3789f-b7a2-49c1-a3f1-74819ced4a46 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:47:06.370592 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0dd8a93c-6819-4ba1-a59e-5cd9ad3e9e1e tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Action: 'create', calling method: .version_select at 0x7f0e5e54baf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-718606287"}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:47:06.970094 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0dd8a93c-6819-4ba1-a59e-5cd9ad3e9e1e tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.723786 Aug 22 17:47:06.970094 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 610/1221] 10.222.0.20 () {60 vars in 1155 bytes} [Mon Aug 22 17:47:06 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 725 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 22 17:47:06.980464 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-98949e67-f446-432a-88c5-b5c5f6e60d60 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e5c466940>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:07.055250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-98949e67-f446-432a-88c5-b5c5f6e60d60 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5" status: 200 len: 344 microversion: 2.1 time: 0.075966 Aug 22 17:47:07.055250 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 612/1222] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 22 17:47:06 2022] GET /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:08.073033 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4c7daa60-87ec-4d75-990c-b4a354e58872 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e60df38b0>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:08.125386 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4c7daa60-87ec-4d75-990c-b4a354e58872 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5" status: 200 len: 345 microversion: 2.1 time: 0.056761 Aug 22 17:47:08.125962 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 611/1223] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 22 17:47:08 2022] GET /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:08.140160 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-9f313515-9164-4409-b441-3b05aa927de6 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Action: 'create', calling method: .version_select at 0x7f0e60f40b80>, body: {"snapshot": {"volume_id": "43ca1ece-5d9a-458f-8b3a-49f5ee649ac5", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1444155394"}} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:47:08.538821 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-9f313515-9164-4409-b441-3b05aa927de6 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.402989 Aug 22 17:47:08.539400 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 613/1224] 10.222.0.20 () {60 vars in 1162 bytes} [Mon Aug 22 17:47:08 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:47:08.551200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9c6dba55-6a51-4107-8ced-73760ed16869 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e5d068310>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:08.584458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9c6dba55-6a51-4107-8ced-73760ed16869 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7" status: 200 len: 287 microversion: 2.1 time: 0.038225 Aug 22 17:47:08.585080 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 612/1225] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 22 17:47:08 2022] GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:08.596457 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-31352179-a8a7-446b-86d2-d4c5844a06e6 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e5dbab430>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:08.630703 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-31352179-a8a7-446b-86d2-d4c5844a06e6 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.037947 Aug 22 17:47:08.631371 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 614/1226] 10.222.0.20 () {58 vars in 1140 bytes} [Mon Aug 22 17:47:08 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:08.642458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-8e6d0e93-0fd9-48e4-9e3d-ec901451284a tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e5cf06d30>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:08.673316 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-8e6d0e93-0fd9-48e4-9e3d-ec901451284a tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7" status: 200 len: 287 microversion: 2.1 time: 0.034767 Aug 22 17:47:08.673982 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 613/1227] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 22 17:47:08 2022] GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:09.687036 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-75771ba3-0a87-4184-88e6-c4e68d89d425 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e5c87c430>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:09.717613 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-75771ba3-0a87-4184-88e6-c4e68d89d425 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7" status: 200 len: 287 microversion: 2.1 time: 0.034798 Aug 22 17:47:09.718209 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 615/1228] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 22 17:47:09 2022] GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:10.730352 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-32235841-396b-4aa0-a42f-c7a657c3ba7a tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e5e54b5e0>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:10.748634 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:47:10.761767 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-32235841-396b-4aa0-a42f-c7a657c3ba7a tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7" status: 200 len: 287 microversion: 2.1 time: 0.035802 Aug 22 17:47:10.762336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 614/1229] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 22 17:47:10 2022] GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:11.772155 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:47:11.772923 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:47:11.777267 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-a33c4f73-01bb-49f1-84b9-22ed8bb8f65c tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e5ca64ee0>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:11.807633 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-a33c4f73-01bb-49f1-84b9-22ed8bb8f65c tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7" status: 200 len: 287 microversion: 2.1 time: 0.036747 Aug 22 17:47:11.808213 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 616/1230] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 22 17:47:11 2022] GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:12.816982 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:47:12.821770 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-2f27ef7f-71ea-40f9-956b-e1f0117b795e tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e5cf06af0>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:12.855723 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-2f27ef7f-71ea-40f9-956b-e1f0117b795e tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7" status: 200 len: 287 microversion: 2.1 time: 0.039503 Aug 22 17:47:12.856307 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 615/1231] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 22 17:47:12 2022] GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:47:13.869326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-b52f9fe3-c892-4ec5-83eb-662684b16f66 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e5c5769d0>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:13.902074 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-b52f9fe3-c892-4ec5-83eb-662684b16f66 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7" status: 200 len: 288 microversion: 2.1 time: 0.036990 Aug 22 17:47:13.902690 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 617/1232] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 22 17:47:13 2022] GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7 => generated 288 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:13.915649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-d16ea6cd-8cc9-4386-91ae-676c9b1e38a5 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e5c6b3d30>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:14.040453 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-d16ea6cd-8cc9-4386-91ae-676c9b1e38a5 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7" status: 202 len: 0 microversion: 2.1 time: 0.129048 Aug 22 17:47:14.041045 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 616/1233] 10.222.0.20 () {58 vars in 1254 bytes} [Mon Aug 22 17:47:13 2022] DELETE /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:47:14.049598 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-053fac79-fbd0-4873-ac87-1f58dfa54f8f tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e60f40af0>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:14.083657 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-053fac79-fbd0-4873-ac87-1f58dfa54f8f tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7" status: 200 len: 287 microversion: 2.1 time: 0.038014 Aug 22 17:47:14.084251 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 618/1234] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 22 17:47:14 2022] GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:15.097108 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-14c48c99-592e-4223-8f9e-1379e7105eb8 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e5d0c7040>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:15.123845 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-14c48c99-592e-4223-8f9e-1379e7105eb8 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] HTTP exception thrown: Snapshot f476917f-65d5-4803-bd83-a52988afacb7 could not be found. Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-14c48c99-592e-4223-8f9e-1379e7105eb8 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Request method failure captured: Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7 HTTP/1.1 Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA8EaxwwUSFvunBnth99Dp5d2XK81L1fnjy0i00TCtEdNuLxeQeP53c3FTP_ot3f_f5scgpIKlI_QZwK6oK3mrYPWdX32xxrWvyIUFi38NK2JvaaXI2DVI3Q1Azszuj_W4y6dLvJj2UwdkOEhGXL_uT6AA769eEeeUowycYyfTR8p_EI Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 4044ffec95424b1bbe743387e9fc9ca4 Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-591889717 Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:47:15.126197 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:47:15.131061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4044ffec95424b1bbe743387e9fc9ca4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4044ffec95424b1bbe743387e9fc9ca4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4044ffec95424b1bbe743387e9fc9ca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4044ffec95424b1bbe743387e9fc9ca4", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:47:15.131061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-VolumesSnapshotsTestJSON-591889717 Aug 22 17:47:15.131061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 4044ffec95424b1bbe743387e9fc9ca4 Aug 22 17:47:15.131061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-591889717 Aug 22 17:47:15.131061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-VolumesSnapshotsTestJSON-591889717-project Aug 22 17:47:15.131061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:47:15.131061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:47:15.131061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 07196310fa194526a9d777eb62c502b5 Aug 22 17:47:15.131061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-VolumesSnapshotsTestJSON-591889717-project Aug 22 17:47:15.131061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: Aug 22 17:47:15.131061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Snapshot f476917f-65d5-4803-bd83-a52988afacb7 could not be found. Aug 22 17:47:15.131061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': 'f476917f-65d5-4803-bd83-a52988afacb7'} Aug 22 17:47:15.131061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f476917f-65d5-4803-bd83-a52988afacb7 could not be found. (HTTP 404) (Request-ID: req-337318eb-564f-425b-a967-dcded5eeaa99) Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:15.132244 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:47:15.133868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f476917f-65d5-4803-bd83-a52988afacb7 could not be found. Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 22 17:47:15.135439 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:47:15.137232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f476917f-65d5-4803-bd83-a52988afacb7 could not be found. Aug 22 17:47:15.137232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:15.137232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:15.137232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:15.137232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:15.137232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:15.137232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:15.137232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:47:15.137232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:47:15.137232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f476917f-65d5-4803-bd83-a52988afacb7 could not be found. Aug 22 17:47:15.137232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:15.137232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-14c48c99-592e-4223-8f9e-1379e7105eb8 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Returning 404 to user: Snapshot f476917f-65d5-4803-bd83-a52988afacb7 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:47:15.137232 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-14c48c99-592e-4223-8f9e-1379e7105eb8 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7" status: 404 len: 111 microversion: 2.1 time: 0.035072 Aug 22 17:47:15.138311 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 617/1235] 10.222.0.20 () {58 vars in 1251 bytes} [Mon Aug 22 17:47:15 2022] GET /compute/v2.1/os-snapshots/f476917f-65d5-4803-bd83-a52988afacb7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:47:15.139241 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-c3e2ee06-bd1a-4d6c-8906-a130bf4492d8 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e60f675e0>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:15.309022 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-c3e2ee06-bd1a-4d6c-8906-a130bf4492d8 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5" status: 202 len: 0 microversion: 2.1 time: 0.174065 Aug 22 17:47:15.309584 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 619/1236] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 22 17:47:15 2022] DELETE /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:47:15.318744 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3c7664ed-6374-40ab-9ad2-1a4c07e545a1 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e5cf7af70>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:15.367652 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3c7664ed-6374-40ab-9ad2-1a4c07e545a1 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5" status: 200 len: 344 microversion: 2.1 time: 0.053324 Aug 22 17:47:15.368223 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 618/1237] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 22 17:47:15 2022] GET /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:47:16.382499 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e1b3eae2-642a-45c4-a173-5b89a30d870a tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e5c5765e0>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:16.411297 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-e1b3eae2-642a-45c4-a173-5b89a30d870a tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] HTTP exception thrown: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e1b3eae2-642a-45c4-a173-5b89a30d870a tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Request method failure captured: Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 HTTP/1.1 Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA8EaxwwUSFvunBnth99Dp5d2XK81L1fnjy0i00TCtEdNuLxeQeP53c3FTP_ot3f_f5scgpIKlI_QZwK6oK3mrYPWdX32xxrWvyIUFi38NK2JvaaXI2DVI3Q1Azszuj_W4y6dLvJj2UwdkOEhGXL_uT6AA769eEeeUowycYyfTR8p_EI Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 4044ffec95424b1bbe743387e9fc9ca4 Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-591889717 Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:47:16.414495 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:47:16.416211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4044ffec95424b1bbe743387e9fc9ca4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4044ffec95424b1bbe743387e9fc9ca4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4044ffec95424b1bbe743387e9fc9ca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4044ffec95424b1bbe743387e9fc9ca4", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:47:16.416211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-VolumesSnapshotsTestJSON-591889717 Aug 22 17:47:16.416211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 4044ffec95424b1bbe743387e9fc9ca4 Aug 22 17:47:16.416211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-591889717 Aug 22 17:47:16.416211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-VolumesSnapshotsTestJSON-591889717-project Aug 22 17:47:16.416211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:47:16.416211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:47:16.416211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: 07196310fa194526a9d777eb62c502b5 Aug 22 17:47:16.416211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-VolumesSnapshotsTestJSON-591889717-project Aug 22 17:47:16.416211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: Aug 22 17:47:16.416211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.416211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': '43ca1ece-5d9a-458f-8b3a-49f5ee649ac5'} Aug 22 17:47:16.416211 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. (HTTP 404) (Request-ID: req-697685a6-8102-49e6-832e-9ab52cd2cd5d) Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:16.417290 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:47:16.418841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 17:47:16.420384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:47:16.421842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.421842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.421842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:16.421842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.421842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:16.421842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:16.421842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:16.421842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:47:16.421842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:47:16.421842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.421842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.421842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e1b3eae2-642a-45c4-a173-5b89a30d870a tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Returning 404 to user: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:47:16.421842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e1b3eae2-642a-45c4-a173-5b89a30d870a tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5" status: 404 len: 109 microversion: 2.1 time: 0.038458 Aug 22 17:47:16.421842 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 620/1238] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 22 17:47:16 2022] GET /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:47:16.431595 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-30d4de78-5102-4608-851b-2d2903be0518 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e5cf06d30>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-30d4de78-5102-4608-851b-2d2903be0518 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] HTTP exception thrown: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-30d4de78-5102-4608-851b-2d2903be0518 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Request method failure captured: Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: DELETE /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 HTTP/1.1 Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA8EaxwwUSFvunBnth99Dp5d2XK81L1fnjy0i00TCtEdNuLxeQeP53c3FTP_ot3f_f5scgpIKlI_QZwK6oK3mrYPWdX32xxrWvyIUFi38NK2JvaaXI2DVI3Q1Azszuj_W4y6dLvJj2UwdkOEhGXL_uT6AA769eEeeUowycYyfTR8p_EI Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: 4044ffec95424b1bbe743387e9fc9ca4 Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-591889717 Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:47:16.464107 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:47:16.465829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4044ffec95424b1bbe743387e9fc9ca4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4044ffec95424b1bbe743387e9fc9ca4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4044ffec95424b1bbe743387e9fc9ca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4044ffec95424b1bbe743387e9fc9ca4", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:47:16.465829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-VolumesSnapshotsTestJSON-591889717 Aug 22 17:47:16.465829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: 4044ffec95424b1bbe743387e9fc9ca4 Aug 22 17:47:16.465829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-591889717 Aug 22 17:47:16.465829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-VolumesSnapshotsTestJSON-591889717-project Aug 22 17:47:16.465829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:47:16.465829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:47:16.465829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: 07196310fa194526a9d777eb62c502b5 Aug 22 17:47:16.465829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-VolumesSnapshotsTestJSON-591889717-project Aug 22 17:47:16.465829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: Aug 22 17:47:16.465829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.465829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '43ca1ece-5d9a-458f-8b3a-49f5ee649ac5'} Aug 22 17:47:16.465829 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. (HTTP 404) (Request-ID: req-130e355f-f9ce-41d3-9810-0cb95c3e5034) Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:16.466899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 22 17:47:16.468446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 22 17:47:16.470027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:47:16.472479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.472479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.472479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:16.472479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.472479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:16.472479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:16.472479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:16.472479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:47:16.472479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:47:16.472479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.472479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.472479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-30d4de78-5102-4608-851b-2d2903be0518 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Returning 404 to user: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:47:16.472479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-30d4de78-5102-4608-851b-2d2903be0518 tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5" status: 404 len: 109 microversion: 2.1 time: 0.037624 Aug 22 17:47:16.472479 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 619/1239] 10.222.0.20 () {58 vars in 1248 bytes} [Mon Aug 22 17:47:16 2022] DELETE /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:47:16.474096 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-09844986-5295-40ec-ba0d-4526567a33ca tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Calling method '.version_select at 0x7f0e60f21160>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:16.502513 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-09844986-5295-40ec-ba0d-4526567a33ca tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] HTTP exception thrown: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-09844986-5295-40ec-ba0d-4526567a33ca tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Request method failure captured: Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 HTTP/1.1 Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA8EaxwwUSFvunBnth99Dp5d2XK81L1fnjy0i00TCtEdNuLxeQeP53c3FTP_ot3f_f5scgpIKlI_QZwK6oK3mrYPWdX32xxrWvyIUFi38NK2JvaaXI2DVI3Q1Azszuj_W4y6dLvJj2UwdkOEhGXL_uT6AA769eEeeUowycYyfTR8p_EI Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: 4044ffec95424b1bbe743387e9fc9ca4 Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-591889717 Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:47:16.504501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:47:16.506270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4044ffec95424b1bbe743387e9fc9ca4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4044ffec95424b1bbe743387e9fc9ca4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4044ffec95424b1bbe743387e9fc9ca4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4044ffec95424b1bbe743387e9fc9ca4", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:47:16.506270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-VolumesSnapshotsTestJSON-591889717 Aug 22 17:47:16.506270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: 4044ffec95424b1bbe743387e9fc9ca4 Aug 22 17:47:16.506270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-591889717 Aug 22 17:47:16.506270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-VolumesSnapshotsTestJSON-591889717-project Aug 22 17:47:16.506270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:47:16.506270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:47:16.506270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: 07196310fa194526a9d777eb62c502b5 Aug 22 17:47:16.506270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-VolumesSnapshotsTestJSON-591889717-project Aug 22 17:47:16.506270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: Aug 22 17:47:16.506270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.506270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': '43ca1ece-5d9a-458f-8b3a-49f5ee649ac5'} Aug 22 17:47:16.506270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. (HTTP 404) (Request-ID: req-5c14e2bd-cfaf-40f7-9a02-40edbe3930d0) Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:16.507388 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 22 17:47:16.508919 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 22 17:47:16.510530 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:47:16.512064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.512064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.512064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:47:16.512064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.512064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:47:16.512064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:47:16.512064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:47:16.512064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:47:16.512064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:47:16.512064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. Aug 22 17:47:16.512064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:47:16.512064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-09844986-5295-40ec-ba0d-4526567a33ca tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] Returning 404 to user: Volume 43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:47:16.512064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-09844986-5295-40ec-ba0d-4526567a33ca tempest-VolumesSnapshotsTestJSON-591889717 tempest-VolumesSnapshotsTestJSON-591889717-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5" status: 404 len: 109 microversion: 2.1 time: 0.036320 Aug 22 17:47:16.512064 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 621/1240] 10.222.0.20 () {58 vars in 1245 bytes} [Mon Aug 22 17:47:16 2022] GET /compute/v2.1/os-volumes/43ca1ece-5d9a-458f-8b3a-49f5ee649ac5 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:47:30.081245 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:47:30.081924 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Mon Aug 22 17:47:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:47:52.631557 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1061911533", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "networks": [{"uuid": "177b4848-bbbf-4795-83f3-5fa69653cff5"}]}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:47:52.686631 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.network.neutron [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] validate_networks() for [('177b4848-bbbf-4795-83f3-5fa69653cff5', None, None, None, None, None)] {{(pid=121852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:47:53.370994 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Flavor limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:47:53.371419 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Image limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:47:53.371899 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Flavor pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:47:53.372313 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Image pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:47:53.372729 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:47:53.382230 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:53.382743 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:53.383179 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:53.383911 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:53.384364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:53.384790 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:53.402122 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Getting quotas for project e14445197d18423bbd90a1c6211451dd. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:47:53.406083 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Getting quotas for user decf7bb66eec469499237b4ebcf9b4eb and project e14445197d18423bbd90a1c6211451dd. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:47:53.417712 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Going to run 1 instances... {{(pid=121852) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:47:53.420045 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:47:53.543972 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-ba6d7f91-cc78-43db-8d34-92e503685f12 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917564 Aug 22 17:47:53.544552 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 620/1241] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:47:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:47:53.556902 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-4dfe3664-1187-4d63-a1a3-49b6b7959252 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:53.557520 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-4dfe3664-1187-4d63-a1a3-49b6b7959252 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:53.616265 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-4dfe3664-1187-4d63-a1a3-49b6b7959252 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:53.623536 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-4dfe3664-1187-4d63-a1a3-49b6b7959252 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1219 microversion: 2.1 time: 0.071500 Aug 22 17:47:53.624082 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 622/1242] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:53 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1219 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:54.646221 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0c059f90-1c95-4bac-9020-ac5744a9af9a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:54.646890 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0c059f90-1c95-4bac-9020-ac5744a9af9a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:54.700824 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0c059f90-1c95-4bac-9020-ac5744a9af9a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:54.711403 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0c059f90-1c95-4bac-9020-ac5744a9af9a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1219 microversion: 2.1 time: 0.070301 Aug 22 17:47:54.711759 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 621/1243] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:54 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:55.737818 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e2101969-8b7c-42ab-af7a-a60cff0adc6b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:55.738445 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e2101969-8b7c-42ab-af7a-a60cff0adc6b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:55.744983 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e2101969-8b7c-42ab-af7a-a60cff0adc6b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:55.748344 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e2101969-8b7c-42ab-af7a-a60cff0adc6b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:55.748344 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e2101969-8b7c-42ab-af7a-a60cff0adc6b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:55.748344 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e2101969-8b7c-42ab-af7a-a60cff0adc6b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:55.748344 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e2101969-8b7c-42ab-af7a-a60cff0adc6b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:55.748861 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e2101969-8b7c-42ab-af7a-a60cff0adc6b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:56.073737 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e2101969-8b7c-42ab-af7a-a60cff0adc6b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:56.081543 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e2101969-8b7c-42ab-af7a-a60cff0adc6b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1271 microversion: 2.1 time: 0.347822 Aug 22 17:47:56.087902 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 623/1244] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:55 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1271 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:57.104639 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0cbb269e-b970-466d-a319-5618daf1a482 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:57.105281 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0cbb269e-b970-466d-a319-5618daf1a482 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:57.112078 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0cbb269e-b970-466d-a319-5618daf1a482 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:57.112691 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0cbb269e-b970-466d-a319-5618daf1a482 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:57.113002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0cbb269e-b970-466d-a319-5618daf1a482 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:57.113963 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0cbb269e-b970-466d-a319-5618daf1a482 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:57.114432 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0cbb269e-b970-466d-a319-5618daf1a482 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:57.114888 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0cbb269e-b970-466d-a319-5618daf1a482 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:57.253563 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-0cbb269e-b970-466d-a319-5618daf1a482 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:57.262004 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0cbb269e-b970-466d-a319-5618daf1a482 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1319 microversion: 2.1 time: 0.161177 Aug 22 17:47:57.262604 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 622/1245] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:57 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:47:57.752395 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-b19aaed1-2cb9-415b-b34f-7595f6c665f6 req-e50d01d6-73f6-4d0d-af42-e1387aad523b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40", "tag": "db26601f-ed29-4528-bccd-c32c3563b41d"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:47:57.764139 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-b19aaed1-2cb9-415b-b34f-7595f6c665f6 req-e50d01d6-73f6-4d0d-af42-e1387aad523b service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:57.764608 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-b19aaed1-2cb9-415b-b34f-7595f6c665f6 req-e50d01d6-73f6-4d0d-af42-e1387aad523b service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:57.765033 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-b19aaed1-2cb9-415b-b34f-7595f6c665f6 req-e50d01d6-73f6-4d0d-af42-e1387aad523b service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:57.777065 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-b19aaed1-2cb9-415b-b34f-7595f6c665f6 req-e50d01d6-73f6-4d0d-af42-e1387aad523b service nova] Creating event network-changed:db26601f-ed29-4528-bccd-c32c3563b41d for instance 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 on hv-cinder-85394 Aug 22 17:47:57.782068 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-b19aaed1-2cb9-415b-b34f-7595f6c665f6 req-e50d01d6-73f6-4d0d-af42-e1387aad523b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033375 Aug 22 17:47:57.782707 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 624/1246] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:47:58.285780 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-34edf6c4-9d0d-4e89-9339-ba9ecea1a1d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:58.286555 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-34edf6c4-9d0d-4e89-9339-ba9ecea1a1d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:58.295957 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34edf6c4-9d0d-4e89-9339-ba9ecea1a1d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:58.296592 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34edf6c4-9d0d-4e89-9339-ba9ecea1a1d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:58.297093 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34edf6c4-9d0d-4e89-9339-ba9ecea1a1d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:58.297809 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34edf6c4-9d0d-4e89-9339-ba9ecea1a1d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:58.298352 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34edf6c4-9d0d-4e89-9339-ba9ecea1a1d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:58.298843 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-34edf6c4-9d0d-4e89-9339-ba9ecea1a1d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:58.440265 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-34edf6c4-9d0d-4e89-9339-ba9ecea1a1d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:58.448589 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-34edf6c4-9d0d-4e89-9339-ba9ecea1a1d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1319 microversion: 2.1 time: 0.168063 Aug 22 17:47:58.449182 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 623/1247] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:58 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:47:59.469583 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-aefbe86d-79e0-4ec1-910f-673b8638e69d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:47:59.470283 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-aefbe86d-79e0-4ec1-910f-673b8638e69d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:47:59.477473 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aefbe86d-79e0-4ec1-910f-673b8638e69d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:59.477973 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aefbe86d-79e0-4ec1-910f-673b8638e69d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:59.478414 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aefbe86d-79e0-4ec1-910f-673b8638e69d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:59.479148 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aefbe86d-79e0-4ec1-910f-673b8638e69d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:47:59.479609 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aefbe86d-79e0-4ec1-910f-673b8638e69d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:47:59.480034 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-aefbe86d-79e0-4ec1-910f-673b8638e69d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:47:59.624555 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-aefbe86d-79e0-4ec1-910f-673b8638e69d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:47:59.633536 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-aefbe86d-79e0-4ec1-910f-673b8638e69d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1319 microversion: 2.1 time: 0.168624 Aug 22 17:47:59.634105 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 625/1248] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:47:59 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:48:00.654925 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-df2bea62-f088-4f26-b3de-be1712081a49 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:48:00.655577 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-df2bea62-f088-4f26-b3de-be1712081a49 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:48:00.665516 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df2bea62-f088-4f26-b3de-be1712081a49 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:00.666200 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df2bea62-f088-4f26-b3de-be1712081a49 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:00.666682 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df2bea62-f088-4f26-b3de-be1712081a49 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:00.667400 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df2bea62-f088-4f26-b3de-be1712081a49 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:00.667856 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df2bea62-f088-4f26-b3de-be1712081a49 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:00.668282 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-df2bea62-f088-4f26-b3de-be1712081a49 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:00.805025 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-df2bea62-f088-4f26-b3de-be1712081a49 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:48:00.812773 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-df2bea62-f088-4f26-b3de-be1712081a49 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1319 microversion: 2.1 time: 0.161829 Aug 22 17:48:00.813362 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 624/1249] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:48:00 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:48:01.833898 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-31ceb5e3-a37f-4f80-bb51-06abc7a05447 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:48:01.834463 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-31ceb5e3-a37f-4f80-bb51-06abc7a05447 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:48:01.841204 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-31ceb5e3-a37f-4f80-bb51-06abc7a05447 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:01.841685 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-31ceb5e3-a37f-4f80-bb51-06abc7a05447 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:01.842116 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-31ceb5e3-a37f-4f80-bb51-06abc7a05447 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:01.842841 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-31ceb5e3-a37f-4f80-bb51-06abc7a05447 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:01.843289 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-31ceb5e3-a37f-4f80-bb51-06abc7a05447 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:01.843705 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-31ceb5e3-a37f-4f80-bb51-06abc7a05447 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:01.981865 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-31ceb5e3-a37f-4f80-bb51-06abc7a05447 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:48:01.992009 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-31ceb5e3-a37f-4f80-bb51-06abc7a05447 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1319 microversion: 2.1 time: 0.162501 Aug 22 17:48:01.992587 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 626/1250] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:48:01 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:48:03.013807 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e72b5db2-75a5-481f-82a9-53fbf4088892 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:48:03.014418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e72b5db2-75a5-481f-82a9-53fbf4088892 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:48:03.021417 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e72b5db2-75a5-481f-82a9-53fbf4088892 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:03.021915 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e72b5db2-75a5-481f-82a9-53fbf4088892 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:03.022357 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e72b5db2-75a5-481f-82a9-53fbf4088892 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:03.023136 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e72b5db2-75a5-481f-82a9-53fbf4088892 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:03.023595 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e72b5db2-75a5-481f-82a9-53fbf4088892 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:03.024024 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e72b5db2-75a5-481f-82a9-53fbf4088892 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:03.163982 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e72b5db2-75a5-481f-82a9-53fbf4088892 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:48:03.173447 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e72b5db2-75a5-481f-82a9-53fbf4088892 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1319 microversion: 2.1 time: 0.163494 Aug 22 17:48:03.174035 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 625/1251] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:48:03 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:48:04.195775 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-56cf84ad-e816-4ab3-b17a-aa7b723db81a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:48:04.196501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-56cf84ad-e816-4ab3-b17a-aa7b723db81a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:48:04.199087 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:04.204308 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-56cf84ad-e816-4ab3-b17a-aa7b723db81a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:04.204801 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-56cf84ad-e816-4ab3-b17a-aa7b723db81a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:04.205279 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-56cf84ad-e816-4ab3-b17a-aa7b723db81a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:04.206005 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-56cf84ad-e816-4ab3-b17a-aa7b723db81a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:04.206512 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-56cf84ad-e816-4ab3-b17a-aa7b723db81a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:04.212398 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-56cf84ad-e816-4ab3-b17a-aa7b723db81a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:04.354870 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-56cf84ad-e816-4ab3-b17a-aa7b723db81a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:48:04.367685 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-56cf84ad-e816-4ab3-b17a-aa7b723db81a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1319 microversion: 2.1 time: 0.176331 Aug 22 17:48:04.368426 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 627/1252] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:48:04 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:48:04.908160 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-4803b2b5-b713-44aa-87a2-59f9985e5c06 req-c18a66db-8b9f-4cd1-8bae-fc03baa090a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40", "name": "network-vif-plugged", "status": "completed", "tag": "db26601f-ed29-4528-bccd-c32c3563b41d"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:48:04.914451 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:04.915684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=8 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:04.921449 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-4803b2b5-b713-44aa-87a2-59f9985e5c06 req-c18a66db-8b9f-4cd1-8bae-fc03baa090a1 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:04.921934 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-4803b2b5-b713-44aa-87a2-59f9985e5c06 req-c18a66db-8b9f-4cd1-8bae-fc03baa090a1 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:04.922368 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-4803b2b5-b713-44aa-87a2-59f9985e5c06 req-c18a66db-8b9f-4cd1-8bae-fc03baa090a1 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:04.936953 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-4803b2b5-b713-44aa-87a2-59f9985e5c06 req-c18a66db-8b9f-4cd1-8bae-fc03baa090a1 service nova] Creating event network-vif-plugged:db26601f-ed29-4528-bccd-c32c3563b41d for instance 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 on hv-cinder-85394 Aug 22 17:48:04.942951 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-4803b2b5-b713-44aa-87a2-59f9985e5c06 req-c18a66db-8b9f-4cd1-8bae-fc03baa090a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038277 Aug 22 17:48:04.943562 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 626/1253] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:48:05.391637 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-353dbd9e-5c14-4994-ac01-4dd509b7dc55 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:48:05.392317 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-353dbd9e-5c14-4994-ac01-4dd509b7dc55 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:48:05.400302 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-353dbd9e-5c14-4994-ac01-4dd509b7dc55 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:05.400793 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-353dbd9e-5c14-4994-ac01-4dd509b7dc55 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:05.401232 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-353dbd9e-5c14-4994-ac01-4dd509b7dc55 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:05.401974 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-353dbd9e-5c14-4994-ac01-4dd509b7dc55 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:05.402431 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-353dbd9e-5c14-4994-ac01-4dd509b7dc55 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:05.408604 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-353dbd9e-5c14-4994-ac01-4dd509b7dc55 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:05.553639 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-353dbd9e-5c14-4994-ac01-4dd509b7dc55 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:48:05.562294 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-353dbd9e-5c14-4994-ac01-4dd509b7dc55 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1319 microversion: 2.1 time: 0.174525 Aug 22 17:48:05.562921 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 628/1254] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:48:05 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:48:06.587101 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-bb478a9f-1b0b-4f46-a444-a7de5694cab0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:48:06.587739 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-bb478a9f-1b0b-4f46-a444-a7de5694cab0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:48:06.594848 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bb478a9f-1b0b-4f46-a444-a7de5694cab0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:06.595346 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bb478a9f-1b0b-4f46-a444-a7de5694cab0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:06.595785 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bb478a9f-1b0b-4f46-a444-a7de5694cab0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:06.596500 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bb478a9f-1b0b-4f46-a444-a7de5694cab0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:06.596956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bb478a9f-1b0b-4f46-a444-a7de5694cab0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:06.597436 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-bb478a9f-1b0b-4f46-a444-a7de5694cab0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:06.748027 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-bb478a9f-1b0b-4f46-a444-a7de5694cab0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:48:06.756721 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-bb478a9f-1b0b-4f46-a444-a7de5694cab0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1319 microversion: 2.1 time: 0.176004 Aug 22 17:48:06.757446 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 627/1255] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:48:06 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:48:07.777239 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-06453bd1-c9cf-41f0-bf07-3cd79f58b5ef tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:48:07.777847 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-06453bd1-c9cf-41f0-bf07-3cd79f58b5ef tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:48:07.784384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-06453bd1-c9cf-41f0-bf07-3cd79f58b5ef tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:07.784900 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-06453bd1-c9cf-41f0-bf07-3cd79f58b5ef tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:07.785372 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-06453bd1-c9cf-41f0-bf07-3cd79f58b5ef tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:07.786072 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-06453bd1-c9cf-41f0-bf07-3cd79f58b5ef tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:07.786539 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-06453bd1-c9cf-41f0-bf07-3cd79f58b5ef tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:07.786969 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-06453bd1-c9cf-41f0-bf07-3cd79f58b5ef tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:07.930237 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-06453bd1-c9cf-41f0-bf07-3cd79f58b5ef tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:48:07.938815 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-06453bd1-c9cf-41f0-bf07-3cd79f58b5ef tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1508 microversion: 2.1 time: 0.165385 Aug 22 17:48:07.939433 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 629/1256] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:48:07 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:48:31.380565 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-a12161ac-d0a7-48b2-aa50-a27ba1c5a39d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2398c32d-5b44-4ae9-947b-8bb8a1d7ee4f", "device": "/dev/sdb"}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:48:31.383508 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-a12161ac-d0a7-48b2-aa50-a27ba1c5a39d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:48:31.385649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:31.386414 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=34 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:48:31.391243 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a12161ac-d0a7-48b2-aa50-a27ba1c5a39d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:31.391732 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a12161ac-d0a7-48b2-aa50-a27ba1c5a39d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:31.392167 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a12161ac-d0a7-48b2-aa50-a27ba1c5a39d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:31.392872 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a12161ac-d0a7-48b2-aa50-a27ba1c5a39d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:48:31.393319 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a12161ac-d0a7-48b2-aa50-a27ba1c5a39d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:48:31.393740 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-a12161ac-d0a7-48b2-aa50-a27ba1c5a39d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:48:32.299007 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-a12161ac-d0a7-48b2-aa50-a27ba1c5a39d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "POST /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.923134 Aug 22 17:48:32.299917 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 628/1257] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 22 17:48:31 2022] POST /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40/os-volume_attachments => generated 194 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:49:00.469933 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-279c280a-2df6-4c5f-a23a-2c4a496180c7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:00.470571 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-279c280a-2df6-4c5f-a23a-2c4a496180c7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:00.472573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=18 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:00.473987 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=38 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:00.479030 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-279c280a-2df6-4c5f-a23a-2c4a496180c7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:00.479659 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-279c280a-2df6-4c5f-a23a-2c4a496180c7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:00.480093 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-279c280a-2df6-4c5f-a23a-2c4a496180c7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:00.480790 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-279c280a-2df6-4c5f-a23a-2c4a496180c7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:00.481241 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-279c280a-2df6-4c5f-a23a-2c4a496180c7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:00.481657 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-279c280a-2df6-4c5f-a23a-2c4a496180c7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:00.595853 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-279c280a-2df6-4c5f-a23a-2c4a496180c7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lazy-loading 'services' on Instance uuid 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:49:00.802970 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-279c280a-2df6-4c5f-a23a-2c4a496180c7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40/os-volume_attachments/2398c32d-5b44-4ae9-947b-8bb8a1d7ee4f" status: 202 len: 0 microversion: 2.1 time: 0.336806 Aug 22 17:49:00.803815 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 630/1258] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 22 17:49:00 2022] DELETE /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40/os-volume_attachments/2398c32d-5b44-4ae9-947b-8bb8a1d7ee4f => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 22 17:49:01.929023 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:01.929793 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:01.933903 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-9d3b3ef6-9902-4104-b9ec-04b65fba7647 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:01.934517 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9d3b3ef6-9902-4104-b9ec-04b65fba7647 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:01.941001 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d3b3ef6-9902-4104-b9ec-04b65fba7647 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:01.941490 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d3b3ef6-9902-4104-b9ec-04b65fba7647 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:01.942468 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d3b3ef6-9902-4104-b9ec-04b65fba7647 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:01.943199 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d3b3ef6-9902-4104-b9ec-04b65fba7647 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:01.943649 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d3b3ef6-9902-4104-b9ec-04b65fba7647 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:01.944068 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-9d3b3ef6-9902-4104-b9ec-04b65fba7647 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:01.969855 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-9d3b3ef6-9902-4104-b9ec-04b65fba7647 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Going to try to terminate instance {{(pid=121852) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:49:02.299940 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-9d3b3ef6-9902-4104-b9ec-04b65fba7647 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 204 len: 0 microversion: 2.1 time: 0.372145 Aug 22 17:49:02.301628 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 629/1259] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:49:01 2022] DELETE /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:49:02.311425 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-745f26a0-125b-44fa-bfab-11675177eba9 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:02.319996 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-745f26a0-125b-44fa-bfab-11675177eba9 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:02.319996 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-745f26a0-125b-44fa-bfab-11675177eba9 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:02.320284 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-745f26a0-125b-44fa-bfab-11675177eba9 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:02.320577 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-745f26a0-125b-44fa-bfab-11675177eba9 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:02.321271 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-745f26a0-125b-44fa-bfab-11675177eba9 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:02.321714 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-745f26a0-125b-44fa-bfab-11675177eba9 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:02.322132 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-745f26a0-125b-44fa-bfab-11675177eba9 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:02.458968 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-745f26a0-125b-44fa-bfab-11675177eba9 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:02.467026 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-745f26a0-125b-44fa-bfab-11675177eba9 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1514 microversion: 2.1 time: 0.160480 Aug 22 17:49:02.467856 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 631/1260] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:02 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:49:03.489352 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-5a3b64f9-8d6f-4143-90e9-1d2db3aca3d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:03.490262 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-5a3b64f9-8d6f-4143-90e9-1d2db3aca3d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:03.497207 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a3b64f9-8d6f-4143-90e9-1d2db3aca3d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:03.497699 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a3b64f9-8d6f-4143-90e9-1d2db3aca3d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:03.498135 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a3b64f9-8d6f-4143-90e9-1d2db3aca3d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:03.498868 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a3b64f9-8d6f-4143-90e9-1d2db3aca3d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:03.499324 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a3b64f9-8d6f-4143-90e9-1d2db3aca3d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:03.499749 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-5a3b64f9-8d6f-4143-90e9-1d2db3aca3d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:03.643261 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-5a3b64f9-8d6f-4143-90e9-1d2db3aca3d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:03.651791 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-5a3b64f9-8d6f-4143-90e9-1d2db3aca3d8 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1514 microversion: 2.1 time: 0.167170 Aug 22 17:49:03.652371 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 630/1261] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:03 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:49:04.665289 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-9ed3e84a-08ed-4b48-922d-8b1ecfb63d26 req-5168694e-8526-4055-aa34-4917efdc399f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40", "name": "network-vif-deleted", "tag": "db26601f-ed29-4528-bccd-c32c3563b41d"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:49:04.672823 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-afdba05c-9871-4244-bea5-a3ebb72b8828 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:04.673545 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-afdba05c-9871-4244-bea5-a3ebb72b8828 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:04.676145 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-9ed3e84a-08ed-4b48-922d-8b1ecfb63d26 req-5168694e-8526-4055-aa34-4917efdc399f service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:04.677173 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-9ed3e84a-08ed-4b48-922d-8b1ecfb63d26 req-5168694e-8526-4055-aa34-4917efdc399f service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:04.677686 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-9ed3e84a-08ed-4b48-922d-8b1ecfb63d26 req-5168694e-8526-4055-aa34-4917efdc399f service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:04.681890 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afdba05c-9871-4244-bea5-a3ebb72b8828 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:04.682454 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afdba05c-9871-4244-bea5-a3ebb72b8828 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:04.684586 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afdba05c-9871-4244-bea5-a3ebb72b8828 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:04.684586 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afdba05c-9871-4244-bea5-a3ebb72b8828 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:04.684586 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afdba05c-9871-4244-bea5-a3ebb72b8828 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:04.685364 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-afdba05c-9871-4244-bea5-a3ebb72b8828 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:04.690419 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-9ed3e84a-08ed-4b48-922d-8b1ecfb63d26 req-5168694e-8526-4055-aa34-4917efdc399f service nova] Creating event network-vif-deleted:db26601f-ed29-4528-bccd-c32c3563b41d for instance 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 on hv-cinder-85394 Aug 22 17:49:04.695874 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-9ed3e84a-08ed-4b48-922d-8b1ecfb63d26 req-5168694e-8526-4055-aa34-4917efdc399f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035344 Aug 22 17:49:04.696734 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 632/1262] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:49:04.765771 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-afdba05c-9871-4244-bea5-a3ebb72b8828 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:04.774750 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-afdba05c-9871-4244-bea5-a3ebb72b8828 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 200 len: 1472 microversion: 2.1 time: 0.105917 Aug 22 17:49:04.775359 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 631/1263] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:04 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 1472 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:49:05.798040 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-de5b8436-ab1a-4924-b5a1-62b7ecb13964 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:05.798752 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-de5b8436-ab1a-4924-b5a1-62b7ecb13964 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:05.806622 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-de5b8436-ab1a-4924-b5a1-62b7ecb13964 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:05.807102 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-de5b8436-ab1a-4924-b5a1-62b7ecb13964 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:05.807543 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-de5b8436-ab1a-4924-b5a1-62b7ecb13964 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:05.808255 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-de5b8436-ab1a-4924-b5a1-62b7ecb13964 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:05.808698 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-de5b8436-ab1a-4924-b5a1-62b7ecb13964 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:05.809114 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-de5b8436-ab1a-4924-b5a1-62b7ecb13964 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:05.823534 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.wsgi [None req-de5b8436-ab1a-4924-b5a1-62b7ecb13964 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] HTTP exception thrown: Instance 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 could not be found. Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-de5b8436-ab1a-4924-b5a1-62b7ecb13964 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Request method failure captured: Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: request: GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 HTTP/1.1 Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept: application/json Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Accept-Encoding: identity Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Connection: close Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Length: 0 Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Content-Type: application/json Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Host: 10.222.0.20 Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Openstack-System-Scope: None Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: User-Agent: python-urllib3/1.26.11 Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Auth-Token: gAAAAABjA8FGC6vjfP7NyOaEE4XcVY6o0-Jgfw9hvelgx_opJ9oBk_RuVcGWD65UZfTZC4o75yMVHBWLAPDOei3u12c0qdRgYU2_BeaBKacrUTcw_N4RV9-Pj2dlLXwHZyOVnuaslOd5On4VcPpHSh4LuHfOQii-YsWnpuYznKBSJWA74K2RCPc Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Id: None Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Domain-Name: None Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Identity-Status: Confirmed Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Is-Admin-Project: True Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Id: default Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Domain-Name: Default Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Id: e14445197d18423bbd90a1c6211451dd Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Project-Name: tempest-VolumesSnapshotTestJSON-759684974 Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Role: reader,member Aug 22 17:49:05.825183 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Roles: reader,member Aug 22 17:49:05.827924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e14445197d18423bbd90a1c6211451dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e14445197d18423bbd90a1c6211451dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e14445197d18423bbd90a1c6211451dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e14445197d18423bbd90a1c6211451dd", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:49:05.827924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant: tempest-VolumesSnapshotTestJSON-759684974 Aug 22 17:49:05.827924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Id: e14445197d18423bbd90a1c6211451dd Aug 22 17:49:05.827924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-759684974 Aug 22 17:49:05.827924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User: tempest-VolumesSnapshotTestJSON-759684974-project Aug 22 17:49:05.827924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Id: default Aug 22 17:49:05.827924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Domain-Name: Default Aug 22 17:49:05.827924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Id: decf7bb66eec469499237b4ebcf9b4eb Aug 22 17:49:05.827924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: X-User-Name: tempest-VolumesSnapshotTestJSON-759684974-project Aug 22 17:49:05.827924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: method: > Aug 22 17:49:05.827924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: exception: Instance 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 could not be found. Aug 22 17:49:05.827924 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: action_args: {'id': '3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40'} Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 could not be found. Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:49:05.829326 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 could not be found. Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 could not be found. Aug 22 17:49:05.832701 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: ERROR nova.api.openstack.wsgi Aug 22 17:49:05.835498 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-de5b8436-ab1a-4924-b5a1-62b7ecb13964 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Returning 404 to user: Instance 3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 could not be found. {{(pid=121853) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:49:05.835498 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-de5b8436-ab1a-4924-b5a1-62b7ecb13964 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40" status: 404 len: 111 microversion: 2.1 time: 0.033293 Aug 22 17:49:05.835498 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 633/1264] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:05 2022] GET /compute/v2.1/servers/3fba40cf-71a5-4fe5-b6a8-eae8f41ecd40 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:49:17.434862 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-707937905", "imageRef": "fcca3e8a-bc2b-4047-8b35-ec5abac624e3", "flavorRef": "452", "networks": [{"uuid": "177b4848-bbbf-4795-83f3-5fa69653cff5"}]}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:49:17.444002 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:17.444241 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:17.492271 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.network.neutron [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] validate_networks() for [('177b4848-bbbf-4795-83f3-5fa69653cff5', None, None, None, None, None)] {{(pid=121852) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 22 17:49:17.869960 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Flavor limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 22 17:49:17.870382 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Image limits 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 22 17:49:17.871072 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Flavor pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 22 17:49:17.871481 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Image pref 0:0:0 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 22 17:49:17.871900 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.virt.hardware [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121852) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 22 17:49:17.881441 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:17.881858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:17.882291 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:17.883053 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:17.883503 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:17.883927 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:17.901420 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Getting quotas for project e14445197d18423bbd90a1c6211451dd. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 22 17:49:17.905306 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.quota [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Getting quotas for user decf7bb66eec469499237b4ebcf9b4eb and project e14445197d18423bbd90a1c6211451dd. Resources: {'cores', 'instances', 'ram'} {{(pid=121852) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 22 17:49:17.916458 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Going to run 1 instances... {{(pid=121852) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 22 17:49:17.918858 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='fcca3e8a-bc2b-4047-8b35-ec5abac624e3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121852) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 22 17:49:18.056501 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-74078a18-59b3-47e0-92ff-b492cd196ad0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625303 Aug 22 17:49:18.057170 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 632/1265] 10.222.0.20 () {60 vars in 1147 bytes} [Mon Aug 22 17:49:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 22 17:49:18.070256 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0c4b3b41-54bf-4d65-a5a2-66ea8f922fd9 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:18.071004 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0c4b3b41-54bf-4d65-a5a2-66ea8f922fd9 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:18.073966 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=8 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:18.074703 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:18.128966 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0c4b3b41-54bf-4d65-a5a2-66ea8f922fd9 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:18.137126 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0c4b3b41-54bf-4d65-a5a2-66ea8f922fd9 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1218 microversion: 2.1 time: 0.072016 Aug 22 17:49:18.137823 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 634/1266] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:18 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:49:19.157204 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-e9150fe5-fc3b-4085-85fa-05e7b6dd3feb tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:19.157816 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-e9150fe5-fc3b-4085-85fa-05e7b6dd3feb tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:19.166040 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9150fe5-fc3b-4085-85fa-05e7b6dd3feb tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:19.166548 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9150fe5-fc3b-4085-85fa-05e7b6dd3feb tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:19.166986 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9150fe5-fc3b-4085-85fa-05e7b6dd3feb tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:19.167679 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9150fe5-fc3b-4085-85fa-05e7b6dd3feb tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:19.168126 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9150fe5-fc3b-4085-85fa-05e7b6dd3feb tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:19.168541 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-e9150fe5-fc3b-4085-85fa-05e7b6dd3feb tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:19.233555 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-e9150fe5-fc3b-4085-85fa-05e7b6dd3feb tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:19.241428 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-e9150fe5-fc3b-4085-85fa-05e7b6dd3feb tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1222 microversion: 2.1 time: 0.088070 Aug 22 17:49:19.242011 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 633/1267] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:19 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:49:20.264060 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-2cfec378-362e-43f5-ac6b-0f0611f9df2b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:20.265716 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-2cfec378-362e-43f5-ac6b-0f0611f9df2b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:20.274551 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2cfec378-362e-43f5-ac6b-0f0611f9df2b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:20.275048 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2cfec378-362e-43f5-ac6b-0f0611f9df2b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:20.275487 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2cfec378-362e-43f5-ac6b-0f0611f9df2b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:20.276270 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2cfec378-362e-43f5-ac6b-0f0611f9df2b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:20.276726 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2cfec378-362e-43f5-ac6b-0f0611f9df2b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:20.277152 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-2cfec378-362e-43f5-ac6b-0f0611f9df2b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:20.360205 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-2cfec378-362e-43f5-ac6b-0f0611f9df2b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:20.369178 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-2cfec378-362e-43f5-ac6b-0f0611f9df2b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1278 microversion: 2.1 time: 0.109606 Aug 22 17:49:20.369845 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 635/1268] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:20 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1278 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:49:21.390880 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-875d0acc-0615-4155-9a4c-53c456afeea0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:21.391483 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-875d0acc-0615-4155-9a4c-53c456afeea0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:21.398456 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-875d0acc-0615-4155-9a4c-53c456afeea0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:21.398973 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-875d0acc-0615-4155-9a4c-53c456afeea0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:21.399409 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-875d0acc-0615-4155-9a4c-53c456afeea0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:21.400108 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-875d0acc-0615-4155-9a4c-53c456afeea0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:21.401284 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-875d0acc-0615-4155-9a4c-53c456afeea0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:21.401741 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-875d0acc-0615-4155-9a4c-53c456afeea0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:21.546308 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-875d0acc-0615-4155-9a4c-53c456afeea0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:21.554404 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-875d0acc-0615-4155-9a4c-53c456afeea0 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1318 microversion: 2.1 time: 0.167346 Aug 22 17:49:21.556535 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 634/1269] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:21 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:49:22.076548 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [req-2a6fafe7-e451-4bff-a7e8-649bffb07d5c req-6ce64a60-4b03-4934-bf61-8c054ce1eefb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a7291bc-7163-4648-9894-eb5b54de0884", "tag": "4b60fafc-7558-4eac-a4e1-d4ead9edf6d4"}]} {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:49:22.090396 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-2a6fafe7-e451-4bff-a7e8-649bffb07d5c req-6ce64a60-4b03-4934-bf61-8c054ce1eefb service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:22.091147 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-2a6fafe7-e451-4bff-a7e8-649bffb07d5c req-6ce64a60-4b03-4934-bf61-8c054ce1eefb service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:22.091828 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [req-2a6fafe7-e451-4bff-a7e8-649bffb07d5c req-6ce64a60-4b03-4934-bf61-8c054ce1eefb service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:22.105391 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.compute.server_external_events [req-2a6fafe7-e451-4bff-a7e8-649bffb07d5c req-6ce64a60-4b03-4934-bf61-8c054ce1eefb service nova] Creating event network-changed:4b60fafc-7558-4eac-a4e1-d4ead9edf6d4 for instance 6a7291bc-7163-4648-9894-eb5b54de0884 on hv-cinder-85394 Aug 22 17:49:22.111628 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [req-2a6fafe7-e451-4bff-a7e8-649bffb07d5c req-6ce64a60-4b03-4934-bf61-8c054ce1eefb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040445 Aug 22 17:49:22.116431 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 636/1270] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:49:22.577976 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-4c8e31b7-85e4-474b-a5b2-84b95951335b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:22.579336 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-4c8e31b7-85e4-474b-a5b2-84b95951335b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:22.586536 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4c8e31b7-85e4-474b-a5b2-84b95951335b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:22.587033 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4c8e31b7-85e4-474b-a5b2-84b95951335b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:22.587508 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4c8e31b7-85e4-474b-a5b2-84b95951335b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:22.588230 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4c8e31b7-85e4-474b-a5b2-84b95951335b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:22.588684 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4c8e31b7-85e4-474b-a5b2-84b95951335b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:22.589109 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-4c8e31b7-85e4-474b-a5b2-84b95951335b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:22.736674 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-4c8e31b7-85e4-474b-a5b2-84b95951335b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:22.745527 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-4c8e31b7-85e4-474b-a5b2-84b95951335b tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1318 microversion: 2.1 time: 0.173333 Aug 22 17:49:22.746118 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 635/1271] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:22 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:49:23.767642 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0d139662-4c95-46aa-be08-87363704962c tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:23.768376 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0d139662-4c95-46aa-be08-87363704962c tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:23.775461 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0d139662-4c95-46aa-be08-87363704962c tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:23.775949 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0d139662-4c95-46aa-be08-87363704962c tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:23.776389 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0d139662-4c95-46aa-be08-87363704962c tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:23.777097 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0d139662-4c95-46aa-be08-87363704962c tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:23.777552 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0d139662-4c95-46aa-be08-87363704962c tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:23.777973 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0d139662-4c95-46aa-be08-87363704962c tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:23.922607 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0d139662-4c95-46aa-be08-87363704962c tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:23.931280 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0d139662-4c95-46aa-be08-87363704962c tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1318 microversion: 2.1 time: 0.167798 Aug 22 17:49:23.931918 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 637/1272] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:23 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:49:24.958138 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-78db9589-1339-485e-b9b4-6ca105d95d2a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:24.958802 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-78db9589-1339-485e-b9b4-6ca105d95d2a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:24.965808 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-78db9589-1339-485e-b9b4-6ca105d95d2a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:24.966388 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-78db9589-1339-485e-b9b4-6ca105d95d2a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:24.967041 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-78db9589-1339-485e-b9b4-6ca105d95d2a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:24.967771 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-78db9589-1339-485e-b9b4-6ca105d95d2a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:24.968230 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-78db9589-1339-485e-b9b4-6ca105d95d2a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:24.968652 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-78db9589-1339-485e-b9b4-6ca105d95d2a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:25.118729 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-78db9589-1339-485e-b9b4-6ca105d95d2a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:25.127418 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-78db9589-1339-485e-b9b4-6ca105d95d2a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1318 microversion: 2.1 time: 0.173404 Aug 22 17:49:25.128015 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 636/1273] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:24 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:49:26.147839 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-292f3504-89f5-4372-82e8-75f1cf02fb47 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:26.148453 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-292f3504-89f5-4372-82e8-75f1cf02fb47 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:26.154947 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-292f3504-89f5-4372-82e8-75f1cf02fb47 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:26.155435 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-292f3504-89f5-4372-82e8-75f1cf02fb47 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:26.155871 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-292f3504-89f5-4372-82e8-75f1cf02fb47 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:26.156628 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-292f3504-89f5-4372-82e8-75f1cf02fb47 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:26.157081 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-292f3504-89f5-4372-82e8-75f1cf02fb47 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:26.157507 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-292f3504-89f5-4372-82e8-75f1cf02fb47 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:26.304502 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-292f3504-89f5-4372-82e8-75f1cf02fb47 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:26.315004 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-292f3504-89f5-4372-82e8-75f1cf02fb47 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1318 microversion: 2.1 time: 0.170975 Aug 22 17:49:26.319403 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 638/1274] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:26 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:49:27.337195 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-63f08623-78ad-494c-bc50-9dc2f800ff1f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:27.337813 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-63f08623-78ad-494c-bc50-9dc2f800ff1f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:27.344441 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-63f08623-78ad-494c-bc50-9dc2f800ff1f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:27.344917 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-63f08623-78ad-494c-bc50-9dc2f800ff1f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:27.345347 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-63f08623-78ad-494c-bc50-9dc2f800ff1f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:27.346039 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-63f08623-78ad-494c-bc50-9dc2f800ff1f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:27.346510 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-63f08623-78ad-494c-bc50-9dc2f800ff1f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:27.346929 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-63f08623-78ad-494c-bc50-9dc2f800ff1f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:27.495557 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-63f08623-78ad-494c-bc50-9dc2f800ff1f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:27.503490 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-63f08623-78ad-494c-bc50-9dc2f800ff1f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1318 microversion: 2.1 time: 0.170692 Aug 22 17:49:27.504065 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 637/1275] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:27 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:49:28.524736 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-0654dd71-b367-488e-886b-0694b05291f4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:28.525352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-0654dd71-b367-488e-886b-0694b05291f4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:28.527823 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell0:SELECT=2 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:28.532795 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0654dd71-b367-488e-886b-0694b05291f4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:28.533286 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0654dd71-b367-488e-886b-0694b05291f4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:28.533726 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0654dd71-b367-488e-886b-0694b05291f4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:28.534432 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0654dd71-b367-488e-886b-0694b05291f4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:28.534926 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0654dd71-b367-488e-886b-0694b05291f4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:28.535352 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-0654dd71-b367-488e-886b-0694b05291f4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:28.675746 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-0654dd71-b367-488e-886b-0694b05291f4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:28.684829 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-0654dd71-b367-488e-886b-0694b05291f4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1318 microversion: 2.1 time: 0.164038 Aug 22 17:49:28.685796 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 639/1276] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:28 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:49:29.406793 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-c68851a6-b824-4651-932b-e446c5d0b892 req-94488299-7a15-40be-b781-c526ace71848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7291bc-7163-4648-9894-eb5b54de0884", "name": "network-vif-plugged", "status": "completed", "tag": "4b60fafc-7558-4eac-a4e1-d4ead9edf6d4"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:49:29.412955 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=2 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:29.413275 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell0:SELECT=6 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:29.419956 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-c68851a6-b824-4651-932b-e446c5d0b892 req-94488299-7a15-40be-b781-c526ace71848 service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:29.420442 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-c68851a6-b824-4651-932b-e446c5d0b892 req-94488299-7a15-40be-b781-c526ace71848 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:29.420871 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-c68851a6-b824-4651-932b-e446c5d0b892 req-94488299-7a15-40be-b781-c526ace71848 service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:29.433953 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-c68851a6-b824-4651-932b-e446c5d0b892 req-94488299-7a15-40be-b781-c526ace71848 service nova] Creating event network-vif-plugged:4b60fafc-7558-4eac-a4e1-d4ead9edf6d4 for instance 6a7291bc-7163-4648-9894-eb5b54de0884 on hv-cinder-85394 Aug 22 17:49:29.439435 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-c68851a6-b824-4651-932b-e446c5d0b892 req-94488299-7a15-40be-b781-c526ace71848 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036186 Aug 22 17:49:29.440046 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 638/1277] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:49:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:49:29.705573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-be1a9ad9-acbd-4d4e-928f-d91b61fad6cf tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:29.706384 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-be1a9ad9-acbd-4d4e-928f-d91b61fad6cf tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:29.713512 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a9ad9-acbd-4d4e-928f-d91b61fad6cf tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:29.714012 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a9ad9-acbd-4d4e-928f-d91b61fad6cf tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:29.714457 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a9ad9-acbd-4d4e-928f-d91b61fad6cf tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:29.715230 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a9ad9-acbd-4d4e-928f-d91b61fad6cf tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:29.715693 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a9ad9-acbd-4d4e-928f-d91b61fad6cf tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:29.716118 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-be1a9ad9-acbd-4d4e-928f-d91b61fad6cf tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:30.173596 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-be1a9ad9-acbd-4d4e-928f-d91b61fad6cf tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:30.183984 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-be1a9ad9-acbd-4d4e-928f-d91b61fad6cf tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1318 microversion: 2.1 time: 0.482463 Aug 22 17:49:30.184578 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 640/1278] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:29 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:49:31.207234 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-b559c399-80f3-4286-9552-87c330fe8a76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:31.208199 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-b559c399-80f3-4286-9552-87c330fe8a76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:31.216406 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b559c399-80f3-4286-9552-87c330fe8a76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:31.216897 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b559c399-80f3-4286-9552-87c330fe8a76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:31.217361 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b559c399-80f3-4286-9552-87c330fe8a76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:31.218133 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b559c399-80f3-4286-9552-87c330fe8a76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:31.218590 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b559c399-80f3-4286-9552-87c330fe8a76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:31.219037 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-b559c399-80f3-4286-9552-87c330fe8a76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:31.434017 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-b559c399-80f3-4286-9552-87c330fe8a76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:31.444686 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-b559c399-80f3-4286-9552-87c330fe8a76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1318 microversion: 2.1 time: 0.242187 Aug 22 17:49:31.445298 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 639/1279] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:31 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:49:32.467255 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-21bbc2be-5ee0-4acb-938f-eb1fd3ca3c1a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:32.467891 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-21bbc2be-5ee0-4acb-938f-eb1fd3ca3c1a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:32.475375 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21bbc2be-5ee0-4acb-938f-eb1fd3ca3c1a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:32.475654 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21bbc2be-5ee0-4acb-938f-eb1fd3ca3c1a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:32.478882 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21bbc2be-5ee0-4acb-938f-eb1fd3ca3c1a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:32.478882 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21bbc2be-5ee0-4acb-938f-eb1fd3ca3c1a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:32.478882 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21bbc2be-5ee0-4acb-938f-eb1fd3ca3c1a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:32.478882 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-21bbc2be-5ee0-4acb-938f-eb1fd3ca3c1a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:32.650501 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-21bbc2be-5ee0-4acb-938f-eb1fd3ca3c1a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:32.659436 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-21bbc2be-5ee0-4acb-938f-eb1fd3ca3c1a tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1507 microversion: 2.1 time: 0.196066 Aug 22 17:49:32.660099 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 641/1280] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:32 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1507 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:49:32.684094 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-35ed8424-2742-4b6a-ab43-4cfe8c14fc0f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "680187e5-b9a5-4258-8472-26b426eefeab", "device": "/dev/sdb"}} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:49:32.686588 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-35ed8424-2742-4b6a-ab43-4cfe8c14fc0f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:32.693073 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-35ed8424-2742-4b6a-ab43-4cfe8c14fc0f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:32.693948 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-35ed8424-2742-4b6a-ab43-4cfe8c14fc0f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:32.694781 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-35ed8424-2742-4b6a-ab43-4cfe8c14fc0f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:32.695658 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-35ed8424-2742-4b6a-ab43-4cfe8c14fc0f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:32.696284 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-35ed8424-2742-4b6a-ab43-4cfe8c14fc0f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:32.696757 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-35ed8424-2742-4b6a-ab43-4cfe8c14fc0f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:33.422122 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-35ed8424-2742-4b6a-ab43-4cfe8c14fc0f tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "POST /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.744134 Aug 22 17:49:33.422983 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 640/1281] 10.222.0.20 () {60 vars in 1323 bytes} [Mon Aug 22 17:49:32 2022] POST /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884/os-volume_attachments => generated 194 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 22 17:49:55.741205 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-d92e42fc-86a6-4096-8902-6e0befc8af93 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:55.741900 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-d92e42fc-86a6-4096-8902-6e0befc8af93 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:55.743962 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_api:SELECT=18 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:55.744635 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG dbcounter [-] [121853] Writing DB stats nova_cell1:SELECT=38 {{(pid=121853) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:55.749613 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d92e42fc-86a6-4096-8902-6e0befc8af93 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:55.750172 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d92e42fc-86a6-4096-8902-6e0befc8af93 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:55.750569 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d92e42fc-86a6-4096-8902-6e0befc8af93 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:55.751276 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d92e42fc-86a6-4096-8902-6e0befc8af93 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:55.751729 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d92e42fc-86a6-4096-8902-6e0befc8af93 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:55.752171 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-d92e42fc-86a6-4096-8902-6e0befc8af93 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:55.842610 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-d92e42fc-86a6-4096-8902-6e0befc8af93 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lazy-loading 'services' on Instance uuid 6a7291bc-7163-4648-9894-eb5b54de0884 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:49:56.068928 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-d92e42fc-86a6-4096-8902-6e0befc8af93 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884/os-volume_attachments/680187e5-b9a5-4258-8472-26b426eefeab" status: 202 len: 0 microversion: 2.1 time: 0.330907 Aug 22 17:49:56.069526 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 642/1282] 10.222.0.20 () {58 vars in 1416 bytes} [Mon Aug 22 17:49:55 2022] DELETE /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884/os-volume_attachments/680187e5-b9a5-4258-8472-26b426eefeab => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 22 17:49:56.725255 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:49:56.725502 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Mon Aug 22 17:49:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:49:57.203188 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:57.204287 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG dbcounter [-] [121852] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 22 17:49:57.208594 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-0cf44fe9-be09-435d-941e-14559c4cd87d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:57.209219 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0cf44fe9-be09-435d-941e-14559c4cd87d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:57.217090 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0cf44fe9-be09-435d-941e-14559c4cd87d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:57.217615 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0cf44fe9-be09-435d-941e-14559c4cd87d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:57.218090 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0cf44fe9-be09-435d-941e-14559c4cd87d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:57.218822 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0cf44fe9-be09-435d-941e-14559c4cd87d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:57.219309 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0cf44fe9-be09-435d-941e-14559c4cd87d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:57.219742 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-0cf44fe9-be09-435d-941e-14559c4cd87d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:57.251914 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-0cf44fe9-be09-435d-941e-14559c4cd87d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Going to try to terminate instance {{(pid=121852) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 22 17:49:57.669296 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-0cf44fe9-be09-435d-941e-14559c4cd87d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 204 len: 0 microversion: 2.1 time: 0.467515 Aug 22 17:49:57.669898 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 641/1283] 10.222.0.20 () {58 vars in 1239 bytes} [Mon Aug 22 17:49:57 2022] DELETE /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 22 17:49:57.680089 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-e18dd2dc-3984-4d66-9d85-a4b52fa0098d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:57.680797 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-e18dd2dc-3984-4d66-9d85-a4b52fa0098d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:57.687573 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e18dd2dc-3984-4d66-9d85-a4b52fa0098d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:57.689938 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e18dd2dc-3984-4d66-9d85-a4b52fa0098d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:57.689938 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e18dd2dc-3984-4d66-9d85-a4b52fa0098d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:57.689938 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e18dd2dc-3984-4d66-9d85-a4b52fa0098d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:57.689938 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e18dd2dc-3984-4d66-9d85-a4b52fa0098d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:57.690353 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-e18dd2dc-3984-4d66-9d85-a4b52fa0098d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:57.836554 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-e18dd2dc-3984-4d66-9d85-a4b52fa0098d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:57.844829 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-e18dd2dc-3984-4d66-9d85-a4b52fa0098d tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1513 microversion: 2.1 time: 0.170141 Aug 22 17:49:57.845421 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 643/1284] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:57 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:49:58.868306 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-3f9ad726-8058-4b54-946e-09d28ef86888 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:49:58.869067 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-3f9ad726-8058-4b54-946e-09d28ef86888 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:49:58.876061 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3f9ad726-8058-4b54-946e-09d28ef86888 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:58.876485 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3f9ad726-8058-4b54-946e-09d28ef86888 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:58.876939 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3f9ad726-8058-4b54-946e-09d28ef86888 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:58.877741 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3f9ad726-8058-4b54-946e-09d28ef86888 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:49:58.878278 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3f9ad726-8058-4b54-946e-09d28ef86888 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:49:58.878765 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-3f9ad726-8058-4b54-946e-09d28ef86888 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:49:59.026821 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.policy [None req-3f9ad726-8058-4b54-946e-09d28ef86888 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121852) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:49:59.035328 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-3f9ad726-8058-4b54-946e-09d28ef86888 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1513 microversion: 2.1 time: 0.172119 Aug 22 17:49:59.035982 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 642/1285] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:49:58 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:50:00.058729 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-97cd903f-1eb8-4d82-9e1d-6914f2dfa3a7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:50:00.059363 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-97cd903f-1eb8-4d82-9e1d-6914f2dfa3a7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:50:00.066516 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97cd903f-1eb8-4d82-9e1d-6914f2dfa3a7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:50:00.069497 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97cd903f-1eb8-4d82-9e1d-6914f2dfa3a7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:50:00.069497 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97cd903f-1eb8-4d82-9e1d-6914f2dfa3a7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:50:00.069497 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97cd903f-1eb8-4d82-9e1d-6914f2dfa3a7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:50:00.069937 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97cd903f-1eb8-4d82-9e1d-6914f2dfa3a7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:50:00.070276 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-97cd903f-1eb8-4d82-9e1d-6914f2dfa3a7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:50:00.304932 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-97cd903f-1eb8-4d82-9e1d-6914f2dfa3a7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:50:00.313597 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-97cd903f-1eb8-4d82-9e1d-6914f2dfa3a7 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1513 microversion: 2.1 time: 0.258902 Aug 22 17:50:00.314195 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 644/1286] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:50:00 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1513 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 22 17:50:00.461038 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [req-d1636857-00a8-4363-818e-6c931c47dc2a req-17bf795f-941d-4c39-94df-fc4b16b5a4af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a7291bc-7163-4648-9894-eb5b54de0884", "name": "network-vif-deleted", "tag": "4b60fafc-7558-4eac-a4e1-d4ead9edf6d4"}]} {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 22 17:50:00.472522 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-d1636857-00a8-4363-818e-6c931c47dc2a req-17bf795f-941d-4c39-94df-fc4b16b5a4af service nova] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:50:00.473018 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-d1636857-00a8-4363-818e-6c931c47dc2a req-17bf795f-941d-4c39-94df-fc4b16b5a4af service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:50:00.473464 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [req-d1636857-00a8-4363-818e-6c931c47dc2a req-17bf795f-941d-4c39-94df-fc4b16b5a4af service nova] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:50:00.493525 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.compute.server_external_events [req-d1636857-00a8-4363-818e-6c931c47dc2a req-17bf795f-941d-4c39-94df-fc4b16b5a4af service nova] Creating event network-vif-deleted:4b60fafc-7558-4eac-a4e1-d4ead9edf6d4 for instance 6a7291bc-7163-4648-9894-eb5b54de0884 on hv-cinder-85394 Aug 22 17:50:00.503071 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [req-d1636857-00a8-4363-818e-6c931c47dc2a req-17bf795f-941d-4c39-94df-fc4b16b5a4af service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.231961 Aug 22 17:50:00.504299 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 643/1287] 10.222.0.20 () {64 vars in 1317 bytes} [Mon Aug 22 17:50:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 22 17:50:01.337504 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.api.openstack.wsgi [None req-cc97ec6c-3046-4408-9828-1aed46491f76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121853) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:50:01.338423 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.compute.api [None req-cc97ec6c-3046-4408-9828-1aed46491f76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121853) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:50:01.347845 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cc97ec6c-3046-4408-9828-1aed46491f76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:50:01.348870 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cc97ec6c-3046-4408-9828-1aed46491f76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:50:01.349625 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cc97ec6c-3046-4408-9828-1aed46491f76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:50:01.350906 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cc97ec6c-3046-4408-9828-1aed46491f76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:50:01.351707 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cc97ec6c-3046-4408-9828-1aed46491f76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:50:01.352458 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cc97ec6c-3046-4408-9828-1aed46491f76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:50:01.390418 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cc97ec6c-3046-4408-9828-1aed46491f76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:50:01.390937 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cc97ec6c-3046-4408-9828-1aed46491f76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:50:01.391366 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG oslo_concurrency.lockutils [None req-cc97ec6c-3046-4408-9828-1aed46491f76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121853) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:50:01.391811 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.objects.instance [None req-cc97ec6c-3046-4408-9828-1aed46491f76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lazy-loading 'fault' on Instance uuid 6a7291bc-7163-4648-9894-eb5b54de0884 {{(pid=121853) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 22 17:50:01.443856 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: DEBUG nova.policy [None req-cc97ec6c-3046-4408-9828-1aed46491f76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'decf7bb66eec469499237b4ebcf9b4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e14445197d18423bbd90a1c6211451dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121853) authorize /opt/stack/nova/nova/policy.py:199}} Aug 22 17:50:01.448991 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO nova.api.openstack.requestlog [None req-cc97ec6c-3046-4408-9828-1aed46491f76 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 200 len: 1308 microversion: 2.1 time: 0.116460 Aug 22 17:50:01.449608 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: [pid: 121853|app: 0|req: 645/1288] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:50:01 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 1308 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 22 17:50:02.474407 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c081e2d8-f9ba-45bb-aa43-40f2f0a9cad4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Calling method '>' {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 22 17:50:02.482283 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.compute.api [None req-c081e2d8-f9ba-45bb-aa43-40f2f0a9cad4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] [instance: 6a7291bc-7163-4648-9894-eb5b54de0884] Fetching instance by UUID {{(pid=121852) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 22 17:50:02.482817 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c081e2d8-f9ba-45bb-aa43-40f2f0a9cad4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:50:02.483416 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c081e2d8-f9ba-45bb-aa43-40f2f0a9cad4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:50:02.483841 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c081e2d8-f9ba-45bb-aa43-40f2f0a9cad4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:50:02.484634 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c081e2d8-f9ba-45bb-aa43-40f2f0a9cad4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Acquiring lock "5c1085d9-5546-41ae-9dbb-982f7045f223" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 22 17:50:02.485171 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c081e2d8-f9ba-45bb-aa43-40f2f0a9cad4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 22 17:50:02.485604 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG oslo_concurrency.lockutils [None req-c081e2d8-f9ba-45bb-aa43-40f2f0a9cad4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Lock "5c1085d9-5546-41ae-9dbb-982f7045f223" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121852) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 22 17:50:02.502772 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.wsgi [None req-c081e2d8-f9ba-45bb-aa43-40f2f0a9cad4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] HTTP exception thrown: Instance 6a7291bc-7163-4648-9894-eb5b54de0884 could not be found. Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c081e2d8-f9ba-45bb-aa43-40f2f0a9cad4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Request method failure captured: Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: request: GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 HTTP/1.1 Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept: application/json Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Accept-Encoding: identity Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Connection: close Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Length: 0 Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Content-Type: application/json Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Host: 10.222.0.20 Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Openstack-System-Scope: None Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: User-Agent: python-urllib3/1.26.11 Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Auth-Token: gAAAAABjA8FGC6vjfP7NyOaEE4XcVY6o0-Jgfw9hvelgx_opJ9oBk_RuVcGWD65UZfTZC4o75yMVHBWLAPDOei3u12c0qdRgYU2_BeaBKacrUTcw_N4RV9-Pj2dlLXwHZyOVnuaslOd5On4VcPpHSh4LuHfOQii-YsWnpuYznKBSJWA74K2RCPc Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Id: None Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Domain-Name: None Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Identity-Status: Confirmed Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Is-Admin-Project: True Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Id: default Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Domain-Name: Default Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Id: e14445197d18423bbd90a1c6211451dd Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Project-Name: tempest-VolumesSnapshotTestJSON-759684974 Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Role: reader,member Aug 22 17:50:02.504440 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Roles: reader,member Aug 22 17:50:02.507390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e14445197d18423bbd90a1c6211451dd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e14445197d18423bbd90a1c6211451dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e14445197d18423bbd90a1c6211451dd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e14445197d18423bbd90a1c6211451dd", "adminURL": "http://10.222.0.20:8080"}]}] Aug 22 17:50:02.507390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant: tempest-VolumesSnapshotTestJSON-759684974 Aug 22 17:50:02.507390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Id: e14445197d18423bbd90a1c6211451dd Aug 22 17:50:02.507390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-759684974 Aug 22 17:50:02.507390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User: tempest-VolumesSnapshotTestJSON-759684974-project Aug 22 17:50:02.507390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Id: default Aug 22 17:50:02.507390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Domain-Name: Default Aug 22 17:50:02.507390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Id: decf7bb66eec469499237b4ebcf9b4eb Aug 22 17:50:02.507390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: X-User-Name: tempest-VolumesSnapshotTestJSON-759684974-project Aug 22 17:50:02.507390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: method: > Aug 22 17:50:02.507390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: exception: Instance 6a7291bc-7163-4648-9894-eb5b54de0884 could not be found. Aug 22 17:50:02.507390 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: action_args: {'id': '6a7291bc-7163-4648-9894-eb5b54de0884'} Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: {{(pid=121852) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a7291bc-7163-4648-9894-eb5b54de0884 could not be found. Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 22 17:50:02.508467 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a7291bc-7163-4648-9894-eb5b54de0884 could not be found. Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a7291bc-7163-4648-9894-eb5b54de0884 could not be found. Aug 22 17:50:02.510373 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: ERROR nova.api.openstack.wsgi Aug 22 17:50:02.515006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: DEBUG nova.api.openstack.wsgi [None req-c081e2d8-f9ba-45bb-aa43-40f2f0a9cad4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] Returning 404 to user: Instance 6a7291bc-7163-4648-9894-eb5b54de0884 could not be found. {{(pid=121852) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 22 17:50:02.515006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO nova.api.openstack.requestlog [None req-c081e2d8-f9ba-45bb-aa43-40f2f0a9cad4 tempest-VolumesSnapshotTestJSON-759684974 tempest-VolumesSnapshotTestJSON-759684974-project] 10.222.0.20 "GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884" status: 404 len: 111 microversion: 2.1 time: 0.037169 Aug 22 17:50:02.515006 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: [pid: 121852|app: 0|req: 644/1289] 10.222.0.20 () {58 vars in 1236 bytes} [Mon Aug 22 17:50:02 2022] GET /compute/v2.1/servers/6a7291bc-7163-4648-9894-eb5b54de0884 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 22 17:50:12.552234 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:50:12.552821 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Mon Aug 22 17:50:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:50:50.089831 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:50:50.090570 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Mon Aug 22 17:50:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:52:16.626579 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:52:16.627135 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Mon Aug 22 17:52:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:52:18.868714 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:52:18.868714 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Mon Aug 22 17:52:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:53:16.734610 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:53:16.735314 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Mon Aug 22 17:53:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:53:32.561503 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:53:32.562218 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Mon Aug 22 17:53:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:54:10.099282 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:54:10.099896 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Mon Aug 22 17:54:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:55:13.408721 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:55:13.409549 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Mon Aug 22 17:55:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:55:36.635157 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:55:36.635826 dv-cinder-853941-2-iscsi devstack@n-api.service[121852]: Mon Aug 22 17:55:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 22 17:55:38.874340 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 22 17:55:38.875031 dv-cinder-853941-2-iscsi devstack@n-api.service[121853]: Mon Aug 22 17:55:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!